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IN THE CLAIMS: 



Please cancel without prejudice Claims 1-92. 

Please add the following newly drafted Claims 93-130. 

93 . A communication system, including a transmitting apparatus and a receiving 
apparatus, for achieving interactivity using a broadcast wave, the transmitting apparatus 
comprising: 

storing means for storing a background image that is main image data to be 
displayed by the receiving apparatus and position information that indicates a position 
within the background image; and 

transmitting means for reading the background image and the position information, 
and for multiplexing and repeatedly transmitting the read background image and the read 
position information, the receiving apparatus comprising: 

supplementary design storing means for storing supplementary designs; 

separating means for separating the background image and the position 
information from the repeatedly transmitted multiplexed background image and position 
information; 

supplementary design reading means for reading a supplementary design from the 

supplementary design storing means; 

combining means for combining the separated background 

image and the read supplementary design at a position in the background image 

indicated by the separated position information to generate image data; and 



1 9 reproducing means for reproducing the generated image data and outputting an 

20 image signal. 

1 94. The communication system of Claim 93, wherein an identification member is 

2 commonly assigned to the main image data and position information. 

1 95. The communication system of Claim 93, wherein the position information is link 

2 information and the supplementary design reading means interprets the link information to 

3 generate a cursor design. 

1 96. A communication system, including a transmitting apparatus and a receiving 

apparatus, for achieving interactivity using a broadcast wave, the transmitting apparatus 

US comprising: 

^; I storing means for storing a background image that is main image data to be 

• displayed by the receiving apparatus and position information that indicates a position 
within 

|W the background image; and 

# transmitting means for reading the background image and the position information, 
9 and for multiplexing and repeatedly transmitting the read background image and the read 

1 0 position information, the receiving apparatus comprising: 

1 1 supplementary design storing means for storing supplementary designs, the 

1 2 supplementary designs including at least one cursor image; 
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1 3 separating means for separating the background image and the position 

1 4 information from the repeatedly transmitted multiplexed background image and 

1 5 position information; 

1 6 supplementary design reading means for reading a supplementary design 

1 7 from the supplementary design storing means; 

1 8 combining means for combining the separated background image and the 

1 9 read supplementary design at a position in the background image indicated by the 
2 0 separated position information to generate image data; and 

2 1 reproducing means for reproducing the generated image data and outputting an 

image signal. 

:|1 97. A communication system, including a transmitting apparatus and a receiving 

apparatus, for achieving interactivity using a broadcast wave, the transmitting apparatus 
,3 comprising: 

41 first storing means for storing a plurality of background images that are main 

pB image data to be displayed by the receiving apparatus and a phirality of sets of control 

' i information, each set of control information including image link information and 

7 supplementary design combining information, the image link information showing a link 

8 from one background image to another background image, and the supplementary design 

9 combining information indicating a combining of at least one supplementary design with a 

1 0 background image and including position information indicating a position in a 

1 1 background image; and 

1 2 transmitting means for reading the background images and the sets of control 
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1 3 information, and for multiplexing and repeatedly transmitting the read background images 

1 4 and sets of control information, the receiving apparatus comprising: 

1 5 supplementary design storing means for storing supplementary designs; 

1 6 separating means for separating one background image and the set of 

1 7 control information corresponding to the one background image from the 

1 8 repeatedly transmitted multiplexed background images and sets of control 

1 9 information; 

2 0 supplementary design reading means for reading a supplementary design 

2 1 from the supplementary design storing means; 

is combining means for combining, based on the supplementary design 

23 combining information included in the separated set of control information, the 

35 separated background image and the read supplementary design at a position in the 

8:5 background image indicated by the position information in the supplementary 

2l design combining information to generate image data; 

f f second storing means for storing the generated image data and the 

2ji separated set of control information; 

2 9 reproducing means for reproducing the generated image data and 

3 0 outputting an image signal; 

3 1 operation means for receiving a user operation that indicates a switching of image 

3 2 data; and control means for controlling the separating means, in response to a user 

3 3 operation, to separate a background image that is indicated by the image link information 

3 4 included in the set of control information stored by the second storing means. 
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1 98 . A communication system, including a transmitting apparatus and a receiving 

2 apparatus, for achieving interactivity using a broadcast wave, the transmitting apparatus 

3 comprising: 

4 first storing means for storing a plurality of background images that are main 

5 image data to be displayed by the receiving apparatus and a plurality of sets of control 

6 information, each set of control information including image link information and 

7 supplementary design combining information, the image link information shovwng a link 

8 from one background image to another background image, and the supplementary design 

9 combining information indicating a combining of at least one supplementary design with a 
li background image and inchiding position information indicating a position in a 

ill background image; and 

I? transmitting means for reading the background unages and the sets of control 

M information, and for multiplexing and repeatedly transmitting the read background images 

y and sets of control information, the receiving apparatus comprising: 

P supplementary design storing means for storing supplementary designs, the 

ii supplementary designs inchidmg at least one cursor image; 

^ ^ separating means for separating one background image and the set of 

^ ^ control information corresponding to the one background image fi-om the 

^ ^ repeatedly transmitted multiplexed background images and sets of control 

20 information; 

2 ^ supplementary design reading means for reading a supplementary design 

2 2 from the supplementary design storing means; 
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2 3 combining means for combining, based on the supplementary design 

2 4 combining information included in the separated set of control information, the 

2 5 separated background image and the read supplementary design at a position in the 

2 6 background image indicated by the position information in the supplementary 

2 7 design combining information to generate image data; 

2 8 second storing means for storing the generated image data and the 

2 9 separated set of control information; 

3 0 reproducing means for reproducing the generated image data and 
3 1 outputting an image signal; 

M operation means for receiving a user operation that indicates a switching of image 

data; and control means for controlling the separating means, in response to a user 

3i operation, to separate a background image that is indicated by the image link information 

3i included in the set of control information stored by the second storing means. 

99. A communication system, inchiding a transmitting apparatus and a receiving 

% apparatus, for achieving interactivity using a broadcast wave, the transmitting apparatus 

S comprising: 

4 first storing means for storing a plurality of background images that are main 

5 image data to be displayed by the receiving-apparatus and a plurality of sets of control 

6 information, each set of control information including image link information and 

7 supplementary design combining information, the hnage link information showing a link 

8 from one background image to another background image, and the supplementary design 

9 combining information indicating a combining of at least one supplementary design with a 
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background image and including position information indicating a position in a 
background image; and transmitting means for reading the background images and the sets 
of control information, and for multiplexing and repeatedly transmitting the read 
background images and sets of control information, the receiving apparatus comprising: 

supplementary design storing means for storing rim supplementary designs, the 
supplementary designs including two types of cursor images that respectively represent a 
selected and a non-selected state; 

separating means for separating one background image and the set of control 
information corresponding to the one background image from the repeatedly transmitted 
multiplexed background images and sets of control information; 

supplementary design reading means for reading a supplementary design from the 
supplementary design storing means; 

combining means for combining, based on the supplementary design combining 
information included in the separated set of control information, the separated background 
image and the read supplementary design at a position in the background image indicated 
by the position information in the supplementary design combining information to generate 
image data; 

second storing means for storing the generated image data and the separated set of 
control information; 

reproducing means for reproducing the generated image data and outputting an 
image signal; 

operation means for receiving a user operation that indicates a switching of image 
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32 data; and control means for controlling the separating means, in response to a user 

3 3 operation, to separate a background image that is indicated by the image link information 

3 4 included in the set of control information stored by the second storing means. 

1 1 00. A transmitting apparatus for use in a communication system that achieves 

2 interactivity using a broadcast wave, the transmitting apparatus comprising: 

3 storing means for storing a background image that is main image data to be 

4 displayed by a receiving apparatus and position information that indicates a position within 

5 the background image, wherein the receiving apparatus combines a supplementary design 
,4 with the background image at the position indicated by the position information, the 

^1 supplementary design being stored by the recersdng apparatus; and 

IB transmitting means for reading the background image and the position information, 

and for multiplexing and repeatedly transmitting the read background image and the read 

1;Q position information. 

^1 101. The transmitting apparatus of Claim 100, forther comprising: 

J| obtdning means for obtaining page information from the World Wide Web on the 

3 Internet, the page information representing a page that is an arrangement of characters and 

4 images and including character information, image information, and link information 

5 showing a link to another page; and 

6 generating means for generating a background image that corresponds to a frame 

7 including characters and images based on the character information and images 

8 information in the obtained page information. 
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1 02. The transmitting apparatus of Claim 100, wherein the storage means further 
stores region size information, the region size information indicating a region size in the 
background image, the supplementary design being combined with a region in the background 
image that is indicated by the position information and the region size information, the 
transmitting means reading the region size information, multiplexing the read region size 
information with the read background information and position information, and repeatedly 
transmitting a result of the multiplexing. 

1 03. The transmitting apparatus of Claim 100, wherein the storing means further 
stores a classification for a specific part of an image, the classification corresponding to a specific 
supplementary design, the transmitting means reading the classification, multiplexing the read 
classification with the read background information and position information, and repeatedly 
transmitting a result of the multiplexing. 

104. The transmitting apparatus of Claim 103, wherein the classification for a 
specific part of an image is for one of a character and image that is linked to another background 
image. 

105. The transmitting apparatus of Claim 103, wherein the classification for a 
specific part of an image is for a heading. 
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1 106. The transmitting Apparatus of Claim 100, wherein the position information 

2 includes an X coordinate and a Y coordinate that indicate a position in the background image, 

3 the receiving apparatus combining a supplementary design with the background image at 

4 the position indicated by the X coordinate and the Y coordinate in the position information. 

1 107. A transmitting apparatus for use in a communication system that achieves 

2 interactivity using a broadcast wave, the transmitting apparatus comprising: 

3 storing means for storing a plurality of background images that are main image 

4 data to be displayed by a receiving apparatus mid a plurality of sets of control information, 
.5, each set of control information including image link information and supplementary design 
^ combining information, the image link information showing a link from one background 
ih image to another background image, and the supplementary design combining information 
1^ indicating a combining of at least one supplementary design with a background image and 
% including position information indicating a position in a background image; and 

Ijt^ transmitting means for reading the background images and the sets of control 

IJll information, and for multiplexing and repeatedly transmitting the read background images 

1 2 and sets of control information. 

1 1 08. A receiving apparatus for use in a communication system that achieves interactivity 

2 using a broadcast wave, wherein a background image and position information are repeatedly 

3 transmitted to the receiving apparatus after being multiplexed, the background image being main 

4 image data to be displayed by the receiving apparatus and the position information indicating a 

5 position in the background image, the receiving apparatus comprising: 
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6 supplementary design storing means for storing supplementary designs; 

7 separating means for separating the background image and the position 

8 information from the repeatedly transmitted multiplexed background image and position 

9 information; 

1 0 supplementary design reading means for reading a supplementary design from the 

1 1 supplementary design storing means; 

1 2 combining means for combining the separated background image and the read 

1 3 supplementary design at the position in the background image indicated by the separated 

1 4 position information to generate image data; and 

l| reproducing means for reproducing the generated image data and outputting an 

m image signal. 

^ I 109. The receiving apparatus of Claim 108, wherein the supplementary designs 

■:2 are figures that give a bold display of headings. 

J| 110. The receivmg apparatus of Claim 108, wherein the background image and 



U position information are repeatedly transmitted to the recei\dng apparatus having been multiplexed 

3 with region size information, the region size information indicating a region size in the 

4 background image, the separating means separating the background image, the position 

5 information, and the region size information from the repeatedly transmitted multiplexed 

6 background image, position information, and region size information, and the combining means 

7 combining the read supplementary design with the separated background image in a region in the 

8 background image that is indicated by the separated position information and region size 

9 information to generate image data, 
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1 1 L The receiving apparatus of Clmm 108, wherein the background image and 

position information are repeatedly transmitted to the receiving apparatus having been multiplexed 
with a classification for a specific part of an image, the classification corresponding to a specific 
supplementary design, the separating means separating the background image, position 
information and classification fi-om the repeatedly transmitted multiplexed background image, 
position information, and classification, and the supplementary design reading means reading the 
supplementary design that corresponds to the separated classification. 

1 12. The receiving apparatus of Claim 1 1 1, wherein the classification for a 
specific part of an image is for one of a character and image that is linked to another background 
image. 

113. The transmitting apparatus of Claim 1 1 1, wherein the classification for a specific 
part of an image is for a heading. 

1 14. The receiving apparatus of Claim 108, wherein the position information includes 
an X coordinate and a Y coordinate that indicate a position in the background image, the 
combining means combining a supplementary design with the separated background image at the 
position indicated by the X coordinate and the Y coordinate in the position information to 
generate image data. 
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115. A receiving apparatus for use in a communication system that achieves interactivity 
using a broadcast wave, wherein a background image and position information that have been 
multiplexed are repeatedly transmitted to the receiving apparatus, the background image being 
main image data to be displayed by the receiving apparatus and the position information indicating 
a position in the background image, the receiving apparatus comprising: 

supplementary design storing means for storing supplementary designs, the 
supplementary designs including at least one cursor image; 

separating meant for separating the background image and the position information 
from the repeatedly transmitted multiplexed background image and position information; 

supplementary design readmg means for reading a supplementary design from the 
supplementary design storing means; 

combining means for combining the separated background image and the read 
supplementary design at a position in the background image indicated by the separated 
position information to generate image data; and 

reproducing means for reproducing the generated image data and outputting an 
image signal. 

1 16. The receiving apparatus of Claim 115, wherein the supplementary designs include 
two types of cursor images that respectively represent a selected and a non-selected state. 
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1 117. The receiving apparatus of Claim 1 1 5, wherein the supplementary designs are 

2 figures showing a plurality of cursor images, the receiving apparatus further comprising: 

3 operation means for receiving a user operation that selects an image showing a 

4 cursor image out of a plurality of images that show cursor images in the supplementary 

5 design storing means, the supplementary design reading means reading the image showing 

6 the selected cursor image, and the combining means combining the read image showing a 

7 cursor image with the separated background image, 

1 1 1 8. A receiving apparatus for use in a communication system that achieves interactivity 

,2, using a broadcast wave, wherein a plurality of background images and sets of control information 

^1 that have been multiplexed are repeatedly transmitted to the recei\dng apparatus, each of the 

\i background images being main image data to be displayed by the receiving apparatus, each set of 

M control information corresponding to a different one of the background images and inckiding 

',6 image link information and supplementary design combining information, the image link 

Ji information showing a link from one background image to another background image; and the 

M supplementary design combining information indicating a combining of at least one supplementary 

9 design with a background image and including position information indicating a position in a 

1 0 background image, the receiving apparatus comprising: 

1 1 supplementary design storing means for storing supplementary designs; 

1 2 separating means for separating one background image and the set of control 

1 3 information corresponding to the one background image from the repeatedly transmitted 

1 4 multiplexed background images and sets of control information; 

15 



1 5 supplementary design reading means for reading a supplementary design from the 

1 6 supplementary design storing means; 

1 7 combining means for combining, based on the supplementary design combining 

1 8 information included in the separated set of control information, the separated 

1 9 background image and the read supplementary design at a position in the background 
2 0 image indicated by the position information in the supplementary design combining 

2 1 information to generate image data; 

2 2 storing means for storing the generated image data and the separated set of 

2 3 control information; 

2J| reproducing means for reproducing the generated image data and outputting an 
image signal; 

2i operation means for receiving a user operation that indicates a switching of image 

2f data; and 

2;i control means for controlling the separatmg means, in response to a user 

21 operation, to separate a background image that is indicated by the image link information 

3;i included in the set of control information stored by the storing means. 

1 1 19. A receiving apparatus for use in a communication system that achieves interactivity 



2 using a broadcast v^ave, wherein a plurality of background images and sets of control information 

3 that have been multiplexed are repeatedly transmitted to the receiving apparatus, each of the 

4 background images being m^n image data to be displayed by the receiving apparatus, each set of 

5 control information corresponding to a different one of the background images and including 

6 image link information and supplementary design combining information, the image link 
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7 information showing a link from one background image to another background image, and the 

8 supplementary design combining information indicating a combining of at least one supplementary 

9 design with a background image and including position information indicating a position in a 
1 0 background image, the receiving apparatus comprising: 



1 1 supplementary design storing means for storing supplementary designs, the 

1 2 supplementary designs including at least one cursor hnage; 

1 3 separating means for separating one background image and the set of control 

1 4 information corresponding to the one background image from the repeatedly transmitted 

1 5 multiplexed background images and sets of control information; 

]J| supplementary design reading means for reading a supplementary design fi*om the 

13 supplementary design storing means; 

li combining means for combining, based on the supplementary design combining 

j3 information included in the separated set of control information, the separated background 

M image and the read supplementary design at a position in the background image indicated 

|1 by the position information in the supplementary design combining information to 

2i generate image data; 

2 3 storing means for storing the generated image data and the separated set of control 

2 4 information; 

2 5 reproducing means for reproducing the generated image data and outputting an 

2 6 image signal; 
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information indicating a combining of at least one supplementary design with a 
background image and including position information indicating a position in a 
background image, 

the receiving apparatus comprising: 

supplementary design storing means for storing supplementary designs, the 
supplementary designs including at least one cursor image; 

separating means for separating one background image and the set of control 
information corresponding to the one background image from the repeatedly transmitted 
multiplexed background images and sets of control information; 

supplementary design reading means for reading a supplementary design from the 
supplementary design storing means; 

combining means for combining, based on the supplementary design combining 
information included in the separated set of control information, the separated background 
image and the read supplementary design at a position in the background image indicated 
by the position information in the supplementary design combining information to generate 
image data; 

storing means for storing the generated image data and the separated set of control 
information; 

reproducing means for reproducing the generated image data and outputting an 
image signal; 

operation means for receiving a user operation that indicates a switching of image 
data; and 
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4 9 control means for controlling the separating means, in response to a user 

5 0 operation, to separate a background image that is indicated by the image link information 
5 1 included in the set of control information stored by the storing means. 

1 1 20. A receiving apparatus for use in a communication system that achieves interactivity 



2 using a broadcast wave, wherein a plurality of background images and sets of control information 

3 that have been multiplexed are repeatedly transmitted to the receiving apparatus, each of the 

4 background images bemg main image data to be displayed by the receiving apparatus, each set of 

5 control information corresponding to a different one of the background images and including 
M image link information and supplementary design combining information, the image link 

iS information showing a link from one background image to another background image, and tiie 

I S supplementary design combining information indicating a combining of at least one supplementary 

^1 design with a background image and including position information indicating a position in a 

to background image, the recei\dng apparatus comprising: 



II supplementary design storing means for storing supplementary designs, the 

ii supplementary designs including two types of cursor images that respectively represent a 

i 3 selected and a non-selected state; 

1 4 separating means for separating one background image and the set of control 

1 5 information corresponding to the one background image from the repeatedly transmitted 

1 6 multiplexed background images and sets of control information; 

1 7 supplementary design reading means for reading a supplementary design from the 

1 8 supplementary design storing means; 
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1 9 combining means for combining, based on the supplementary design combining 

2 0 information included in the separated set of control information, the separated background 

2 1 image and the read supplementary design at a position in the background image indicated 

22 by the position information in the supplementary design combining information to generate 
2 3 image data; 

2 4 storing means for storing the generated image data and the separated set of control 

2 5 information; 

2 6 reproducing means for reproducing the generated image data and outputting an 
27 image signal; 

2^; operation means for receiving a user operation that indicates a switching of image 

2l data; and 

3# control means for controlling the separating means, in response to a user 

39 operation, to separate a background image that is indicated by the image link information 

3 |f included in the set of control information stored by the storing means. 

% 121. A transmitting method for use by a transmitting apparatus in a communication 

2 system that achieves interactivity using a broadcast wave, the transmitting apparatus including 

3 storing means for storing a background image that is mmn image data to be displayed by a 

4 receiving apparatus and position information that indicates a position within the background 

5 image, the receiving apparatus combining a supplementary design with the background image at 

6 the position indicated by the position information, the supplementary design being stored by the 

7 receiving apparatus, the transmitting method comprising: 
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a transmitting step for reading the background image and the position information, 
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and for multiplexing and repeatedly transmitting the read background image and the read 
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position information. 
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122. A transmitting method for use by a transmitting apparatus in a communication 



2 system that achieves interactivity using a broadcast wave, the transmitting apparatus including 

3 storing means for storing a plurality of background images that are main image data to be 

4 displayed by a receiving apparatus and a plurality of sets of control information, each set of 

5 control information including image link information and supplementary design combining 

J information, the image link information showing a link from one background image to another 

^fj background image, and the supplementary design combining information indicating a combining 

li of at least one supplementary design v^th a background image and including position information 

W indicating a position in a background image, the transmitting method comprising: 

I'Q a transmitting step for reading the background images and the sets of control 

information, and for multiplexing and repeatedly transmitting the read background images 

X& and sets of control information. 

1 123. A receiving method for use by a receiving apparatus in a communication system 

2 that achieves interactivity using a broadcast wave, wherein a background image and position 

3 information are repeatedly transmitted to the receiving apparatus after being multiplexed, the 

4 background image being main image data to be displayed by the receiving apparatus and the 

5 position information indicating a position in the background image, the receiving apparatus 
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6 including a supplement^ design storing means for storing supplementary designs, the receiving 

7 method comprising: 

8 a separating step for separating the background image and the position information 

9 from the repeatedly transmitted multiplexed background image and position information; 

10 a supplementary design reading step for reading a supplementary design from the 

1 1 supplementary design storing means; 

12 a combining step for combining the separated background image and the read 

1 3 supplementary design at the position in the background image indicated by the separated 

1 4 position information to generate image data; and 

a reproducing step for reproducing the generated image data and outputting gal 
iji image signal 

124. A receiving method for use by a receiving apparatus in a communication system 

; g that achieves interactivity using a broadcast wave, wherein a background image and position 

^ information that have been muUiplexed are repeatedly transmitted to the receiving apparatus, the 



]A background image being main image data to be displayed by the receiving apparatus and the 

5 position information indicating a position in the background image, the receiving apparatus 

6 including supplementary design storing means for storing supplementary designs, the 



7 supplementary designs including at least one cursor image, the receiving method comprising: 

8 a separating step for separating the background image and the position 

9 information from the repeatedly transmitted multiplexed background image and position 
1 0 information; 
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a supplementary design reading step for reading a supplementary design from the 
supplementary design storing step; 

a combining step for combining the separated background unage and the read 
supplementary design at a position in the background image indicated by the separated 

position information to generate image data; and 
a reproducing step for reproducing the generated unage data and outputting an image 

signal. 

1 25 . A receiving method for use by a receiving apparatus in a communication system 
that achieves interactivity using a broadcast wave, wherein a plurality of background images and 
sets of control information that have been multiplexed are repeatedly transmitted to the receiving 
apparatus, each of the background images being main image data to be displayed by the receiving 
apparatus, each set of control information corresponding to a different one of the background 
images and including image link information and supplementary design combining information, the 
image link information showing a link from one background image to another background image, 
and the supplementary design combining information indicating a combining of at least one 
supplementary design with a background image and including position information indicating a 
position in a background image, the receiving apparatus including a supplementary design storing 
means for storing supplementary designs, the receiving method comprising: 

a separating step for separating one background image and the set of control 

information corresponding to the one background image from the repeatedly transmitted 

multiplexed background images and sets of control information; 
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15 a supplementary design reading step for reading a supplementary design from the 

1 6 supplementary design storing means, 

17 a combining step for combining, based on the supplementary design combining 

1 8 information included in the separated set of control information, the separated background 

1 9 image and the read supplementary design at a position in the background image indicated 

20 by the position information in the supplementary design combining information to generate 

2 1 image data; 

22 a storing step for storing the generated image data and the separated set of control 
2 3 information; a reproducing step for reproducing the generated image data and outputting 
2:|5 an image signal; 

an operation step for receiving a user operation that indicates a switching of image data; 



^0 and a control step for controlling the separating step, in response to a user operation, to separate 
a background image that is indicated by the image link information included in the set of control 
'2 information stored by the storing step. 

126. A computer-readable recording medium recording a receiving program for use by 

2 a receiving apparatus in a communication system that achieves interactivity using a broadcast 

3 wave, wherein a background image and position information are repeatedly transmitted to the 

4 receiving apparatus after being multiplexed, the background image being main image data to be 

5 displayed by the receiving apparatus and the position information indicating a position in the 

6 background image, the recei\dng apparatus including a supplementary design storing means for 

7 storing supplementary designs, the receiving program comprising: 
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a separating step for separating the background image and the position information 
from the repeatedly transmitted multiplexed background image and position information; 

a supplementary design reading step for reading a supplementary design from the 
supplementary design storing means; 

a combining step for combining the separated background image and the read 
supplementary design at the position in the background image indicated by the separated 
position information to generate image data; and 

a reproducing step for reproducing the generated image data and outputting an image 

signal 

127. A computer-readable recording medium recording a receiving program for use by 
a receiving apparatus in a communication system that achieves interactivity using a broadcast 
wave, wherein a background image and position information that have been multiplexed are 
repeatedly transmitted to the receiving apparatus, the background image being main image data to 
be displayed by the receiving apparatus and the position information indicating a position in the 
background image, the receiving apparatus including supplementary design storing means for 
storing supplementary designs, the supplementary designs including at least one cursor image, the 
receiving program comprising: 

a separating step for separating the background image and the position information 
from the repeatedly transmitted multiplexed background image and position information; 

a supplementary design reading step for reading a supplementary design from the 
supplementary design storing step; 
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13 a combining step for combining the separated background image and the read 

1 4 supplementary design at a position in the background image indicated by the separated 

1 5 position information to generate image data; and 

a reproducing step for reproducing the generated image data and outputting an image 

signal. 

1 128. A computer-readable recording medium recording a receiving program for use by 



2 a receivmg apparatus in a communication system that achieves interactivity using a broadcast 

3 wave, wherein a plurality of background images and sets of control information that have been 
A multiplexed are repeatedly transmitted to the. receiving apparatus, each of the background 

M images being main image data to be displayed by the receiving apparatus, each set of control 

i§ information correspondmg to-a different one of the background images and including image link 

IM information and supplementary design combining information, the image link information showing 

; | a link from one background image to another background image, and the supplementary design 

;| combining information indicating a combining of at least one supplementary design with a 

XQi background image and including position mformation indicating a position in a background 



1 1 image, the receiving apparatus including a supplementary design storing means for storing 

1 2 supplementary designs, the receiving program comprising: 

13 a separating step for separating one background image and the set of control 

1 4 information corresponding to the one background image from the repeatedly transmitted 

1 5 multiplexed background images and sets of control information; 

16 a supplementary design reading step for reading a supplementary design from the 

1 7 supplementary design storing means; 
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18 a combining step for combining, based on the supplementary design combining 

1 9 information included in the separated set of control information, the separated background 
2 0 image and the read supplementary design at a position in the background image mdicated 

21 by the position information in the supplementary design combining information to generate 

22 image data; 

23 a storing step for storing the generated image data and the separated set of control 

24 information; 

25 a reproducing step for reproducing the generated image data and outputting an 

2 6 image signal; 

sJl an operation step for receiving a user operation that indicates a switching of image 

2| data; and 

2i a control step for controlling the separating step, in response to a user operation, 

3i to separate a background image that is indicated by the image link information included in 

3 K the set of control information stored by the storing step. 

129. A computer-readable recording medium recording a receiving program for use by 



2 a receiving apparatus in a communication system that achieves interactivity using a broadcast 

3 wave, wherein a plurality of background images and sets of control information that have been 

4 multiplexed are repeatedly transmitted to the receiving apparatus, each of the background images 

5 being main image data to be displayed by the receiving apparatus, each set of control information 

6 corresponding to a different one of the background images and including image link information 

7 and supplementary design combining information, the image link information showing a link from 

8 one background image to another background image, and the supplementary design combining 
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9 information indicating a combining of at least one supplementary design Avith a background image 

1 0 and including position information indicating a position in a background image, the receiving 

1 1 apparatus including a supplementary design storing means for storing supplementary designs, the 

12 supplementary designs including at least one cursor image, the receiving program comprising: 

13 a separating step for separating one background image and the set of control 

1 4 information corresponding to the one background image from the repeatedly transmitted 

1 5 multiplexed background images and sets of control information; 

16 a supplementary design reading step for reading a supplementary design from the 

1 7 supplementary design storing means; 

a combining step for combining, based on the supplementary design combining 

iji information included in the separated set of control information, the separated background 

2 i image and the read supplementary design at a position in the background image indicated 

26 by the position information in the supplementary design combining information to generate 
2^ image data; 

a storing step for storing the generated image data and the separated set of control 

2:S information; 

25 a reproducing step for reproducing the generated image data and outputting an 

2 6 image signal; 

27 an operation step for receiving a user operation that indicates a svdtching of image 
2 8 data; and 
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a control step for controlling the separating step, in response to a user operation, to 
separate a background image that is indicated by the image link information included in the set of 
control information stored by the storing step. 

1 1 3 0. A computer-readable recording medium recording a receiving program for use by 

2 a receiving apparatus in a communication system that achieves mteractivity using a broadcast 

3 wave, wherein a plurality of background images and sets of control information that have been 

4 multiplexed are repeatedly transmitted to the receiving apparatus, each of the background images 

5 being main image data to be displayed by the receixdng apparatus, each set of control information 
,6. corresponding to a different one of the background images and including image link information 
M and supplementary design combining information, the image link uiformation showing a link from 
^1 one background image to another background image, and the supplementary design combining 
\U information indicating a combining of at least one supplementary design with a background image 

rg. and including position information indicating a position m a background image, the receiving 
r;t apparatus including a supplementary design storing means for storing supplementary designs, the 
IJIj supplementary designs including two types of cursor images that respectively represent a selected 



1 3 and a non-selected state, the receiving program comprising: 

14 a separating step for separating one background image and the set of control 

1 5 information corresponding to the one background image from the repeatedly transmitted 

1 6 multiplexed background images and sets of control information; 

17 a supplementary design reading step for reading a supplementary design from the 

1 8 supplementary design storing means; 



29 



19 a combining step for combining, based on the supplementary design combining 

2 0 information included in the separated set of control information, the separated background 

2 1 image and the read supplementary design at a position in the background image indicated 

22 by the position information in the supplementary design combining information to generate 

23 image data; 

24 a storing step for storing the generated image data and the separated set of control 
2 5 information; 

2 6 a reproducing step for reproducing the generated image data and outputting an 

27 image signal; 

?S an operation step for receiving a user operation that indicates a switching of image 

2j I data; and 

^ii a control step for controlling the separating step, in response to a user operation, to 



separate a background image that is indicated by the image link information included in the set of 
control information stored by the storing step. 
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DATA COMMUNICATION SYSTEM;. DATA TRANSMITTING APPARATUS, 
AND DATA RECEIVING APPARATUS 



BACKGROUND OF THE INVENTION 

(1) Field of the Invention 

The present invention relates to a data communication 
system, and to a data transmitting apparatus and data 
receiving apparatus, where simulated bidirectional 
communication processing is performed between a data 
transmitting apparatus and a data receiving apparatus using 
one-way communication, such as a television (TV) broadcast. 

(2) Description of the Prior Art 

It is now possible to connect personal computers in the 
home to networks using a standard telephone line and so 
receive a great variety of information provided by servers 
around the world. The most representative example of such a 
network is the World Wide Web. (WWW) on the Internet. WWW 
servers transmit a combination of image information and 
control information, which has the image information 
displayed within text information, to personal computers as 
the data for displaying a one-page image on the personal 
computer's screen. When such pages are made up of text 
information alone, only control information for displaying 
this text information is transmitted. This control 
information is written using HTML (HyperText Markup 



Language), with browser software executed by the personal 
computer decoding and executing the HTML code to display 
each page on the WWW which is downloaded by the user. Here, 
information indicating a link to another page can be 
5 attached to character strings and images in a page, so that 
when the user makes a selection operation for such a 
character string or image using a mouse, for example, the 
browser will access the WWW server that provides the 
indicated page and will obtain the information for 
10 displaying this new page. On obtaining this information, 
the browser will decode and execute its content to display 
the new page . 

Japanese Laid-Open Patent Application 7-322226 (1995) 
discloses a method for multiplexing control information that 

15 can generate the kind of interactive display described above 
into a TV broadcast which is transmitted using a TV 
broadcast ground wave. In this method, the program 
transmitting apparatus multiplexes data, written in a 
language which resembles HTML for composing an interactive 

20 screen, into a program broadcast before transmitting. On 
receiving this broadcast, the program receiving apparatus 
interprets the composition of the interactive screen and 
combines basic display elements which have been stored 
inside its construction in accordance with the indicated 

25 composition to display the interactive screen. 

The above method has a major drawback in that the 
control information is written in a language for indicating 




a variety of control operations which are performed for 
display, so that the receiving apparatus needs to interpret 
and execute these control operations one by one to perform 
display. Additionally, most high resolution images provided 

5 by WWW servers are compressed using complex techniques, so 
that when a receiving apparatus attempts to display such 
image information, it is usually necessary to perform 
decompression in addition to the processes for display in 
accordance with the control information. Since such complex 

10 processing is required, the load of the receiving apparatus 
is considerable, which greatly increases the cost of the 
necessary hardware for the receiving apparatus. This 
problem makes this communication method unsuitable for a TV 
broadcast communication system in which transmission is 

15 performed from a small number of transmitting apparatuses to 
a large number of receiving apparatuses. 

SUMMARY OF THE INVENTION 

In view of the above problems, it is a first object of 
the present invention to provide a transmitting apparatus, a 

20 receiving apparatus, a reception method, a medium storing a 
reception program, and a communication system where 
interactivity is achieved by simulated bidirectional 
communication between a data transmitting apparatus and a 
data receiving apparatus in a one-way communication system 

25 such as a TV broadcast system, without increasing the load 
of the data receiving apparatus. 



A second object of the present invention is to have an 
image which emphasizes a specific part of the display image 
displayed by the receiving apparatus in addition to 
supplementary designs for a variety of buttons which make 
operations clearer and easier to understand for the user. 
Here, the user is able to customize these supplementary 
designs, the designs having a further benefit of reducing 
the amount of data transmitted to the receiving apparatus. 

These objects can be achieved by a transmitting 
apparatus for an interactive communication system using a 
broadcast wave, including: a first storage unit for storing 
a plurality of frames of image data; a second storage unit 
for storing control information which shows links between 
the plurality of frames of image data stored in the first 
storage unit, and which indicates a combining of a 
supplementary design with the image data stored in the first 
storage unit, the supplementary design being stored by a 
receiving apparatus and being combined with an image 
represented by the image data; and a transmitting unit for 
repeatedly transmitting a predetermined number of frames of 
image data together with corresponding control information. 

With the above construction, image data, control 
information corresponding to the image data, and information 
indicating the combining of the image data with 
supplementary designs are repeatedly transmitted. The 
receiving apparatus will definitely receive the information 
indicating the combining of supplementary designs and the 



linked image data indicated by the control information the 
next time such data is transmitted in the transmission 
cycle, so that interactive jumps to a user's desired image 
data can be performed one after the other. As a result, 
5 broadcast signals which are limited to communication in one 
direction can be used to achieve an interactiveness which 
for the user will resemble bidirectional communication. 
Also, having the receiving apparatus combine supplementary 
designs with the image data makes the system very easy to 
10 operate. 

Here, the transmitting apparatus may include an 
obtaining unit for obtaining pieces of page information 
representing a page containing characters and images, the 
page information including link information to show a link 
15 to another page, character information, and image 

information; a first producing unit for producing one frame 
of image data containing characters and images in accordance 
with the character information and image information 
included in a piece of page information; and a second 
20 producing unit for interpreting the link information 

included in the obtained page information and producing, for 
each frame of image data, control information including 
image link information about a link to another frame of 
image data and supplementary design combining information 
25 indicating a combining of a supplementary design with the 
frame of image data generated by the first producing unit, 
the supplementary design being stored by a receiving 




apparatus and being combined with an image represented by 
the image data. 

With the above construction, page information received 
from an external source can be converted into image data, 
5 control information, and supplementary design information 
which indicates a combining of supplementary designs for 
each set of image data, these sets of data being suited to 
broadcasting. 

Here, the obtaining unit may obtain the page 
10 information from the World Wide Web on the Internet. 

With the above construction, the transmitting apparatus 
can convert HTML documents on WWW servers on the Internet 
into image data, control information, and supplementary 
design information which it then broadcasts. As a result, 
15 the transmitting apparatus can provide users with an 

interactive program which resembles "net surfing" on the 
Internet using only a TV broadcast wave. 

Here, the determining unit may determine a headline as 
the specified image part, and the generating unit may 
20 generate supplementary design combining information which 
indicates a combining of the specific image part with a 
supplementary design for bold display. 

With the above construction, the transmitting apparatus 
can detect the headline written in an HTML dociament on a WWW 
25 server on the Internet and can generate supplementary design 
combining information indicating a combining of the 
supplementary design at an image position of the headline. 



The receiving apparatus receives this supplementary design 
combining information and combines a supplementary design, 
which is made up of a frame which surrounds the title of the 
image data, with the image data to emphasize the title of 
the image data . 

Here, the determining unit may determine one of a 
character and an image to which a link has been attached as 
the specific image part, and the generating unit may 
generate supplementary design combining information 
indicating a combining of supplementary design, which shows 
that a link to another frame of image data is attached, with 
the specified image part. 

With the above construction, the transmitting apparatus 
can determine the characters and images in a HTML page which 
have a link to another image attached to them and can 
generate supplementary design combining information 
indicating a combining of these characters and images with a 
supplementary design. The receiving apparatus receives this 
supplementary design combining information and superimposes 
a supplementary design showing the attachment of a link to 
another image at a position in the image data of such linked 
character or image to emphasize the characters and images to 
which links to other image data have been attached. 

Here, the second producing unit may include: a 
supplementary design storage unit for storing a 
supplementary design beforehand; and a supplementary design 
adding unit for reading a supplementary design from the 




supplementary design storage unit and for adding the read 
supplementary design to the stored control information. 

With the above construction, the transmitting apparatus 
adds supplementary designs, which it already stores, to the 
5 control information, so that a receiving apparatus can 

receive this control information including supplementary 
designs from the transmitting apparatus, and can obtain the 
supplementary designs from the control information which it 
then stores. The receiving apparatus can then combine these 
10 received supplementary designs with image data, meaning that 
a variety of supplementary designs may be used by the 
receiving apparatus . 

The objects of the present invention can also be 
achieved by a receiving apparatus for an interactive 
15 communication system using a broadcast wave, wherein the 
broadcast wave is produced by multiplexing a plurality of 
frames of image data, and control information which includes 
image link information for each frame of image data showing 
links with other frames of image data and supplementary 
20 design combining information indicating the combining of a 
supplementary design with the plurality of frames of image 
data, the broadcast wave being' repeatedly transmitted, and 
the supplementary design being combined with an image of the 
image data, wherein the receiving apparatus includes: a 
25 separating unit for separating a frame of image data and 

corresponding control information from the broadcast wave; a 
supplementary design storage unit for storing at least one 



supplementary design; a supplementary design reading unit 
for reading a supplementary design from the supplementary 
design storage unit, based on the separated control 
information; a combining unit for combining the read 
supplementary design with the separated image data; a 
storage unit for storing the combined image data and 
separated control information; a reproducing unit for 
reproducing the stored image data to output an image signal; 
an operation unit for receiving an operation instruction 
from a user to switch image data; and a control unit for 
controlling the separating unit to separate another frame of 
image data designated by the control information stored in 
the storage unit according to the operation instruction. 

With the above construction, the receiving apparatus 
receives the broadcast wave from the transmitting apparatus 
and separates one set of image data, reproduces it, and 
outputs it as an image signal in accordance with user 
operations to achieve a simulated interactive environment. 
The receiver apparatus will definitely receive the image 
data indicated by control information and the control 
information for combining the image data with supplementary 
designs the next time this information is broadcast in the 
repeated transmission, so that the user can interactively 
select the linked image data which is to be displayed next. 
As a result, what appears to the user as interactive display 
using bidirectional communication can be achieved using a TV 
broadcast wave which only allows communication in one 




direction. Also, while servers in a bidirectional 
communication system have a load which changes depending on 
the number of requests from receiving apparatuses, meaning 
that the response time taken for the switching of the 
5 display image by a receiver apparatus can greatly vary, in 

the present invention the transmitting apparatus has no such 
changing load and so has a fixed cycle for repeatedly 
broadcasting all of the image data. As a result, the 
receiving apparatus will always be able to switch the image 
10 data within a fixed response time, which at most will be the 
time taken by one transmission cycle. The control 
information received by the receiving apparatus includes 
information indicating a combining of a supplementary design 
with the image data, so that the supplementary design can be 
15 superimposed onto the image data to assist the user in 
making his/her operations. 

Here, the classification may indicate a headline as the 
specific image part and the supplementary design specifying 
unit may specify a supplementary design which emphasizes the 
20 specific image part. 

With the above construction, the receiving apparatus 
receives the supplementary design combining infoormation, and 
combines the supplementary design, which is a frame which 
surrounds the title of the display image, with the image 
25 data to emphasize the title. 

Here, the classification may indicate one of a 
character and image to which a link has been attached as the 



specific image part and the supplementary design specifying 
unit may specify a supplementary design which shows that the 
specific image part has an attached link to other image 
data . 

With the above construction, the transmitting apparatus 
receives supplementary design combining information and 
combines the supplementary designs showing links to other 
image data at the positions of characters or images which 
are linked to other sets of image data, so that the 
characters or images which are linked to other sets of image 
data are emphasized in the display. 

Here, the supplementary designs stored in the 
supplementary design storage unit which are used for showing 
that a link to other image data is attached may be composed 
of two types which respectively correspond to a selection 
and a non-selection state, the operation unit may receive a 
selection operation from the user for one of a character and 
an image to which a link is attached, the receiving 
apparatus may include a state storage unit for storing a 
selection or non-selection state in accordance with an 
instruction from the operation unit, and the supplementary 
design reading unit may read a' supplementary design 
corresponding to a state stored in the state storage unit 
from the supplementary design storage unit. 

With the above construction, the supplementary designs 
are of two types which respectively show a selection and a 
non-selection state, so that the receiving apparatus can 




change the supplementary designs to be combined with the 
image data depending on whether the corresponding item is 
selected or not by the user. This clarification of the 
display assists the user in making his/her operations . 
5 Here, the control information received from a 

transmitting apparatus may further include a supplementary 
design, and the receiving apparatus may further comprise a 
supplementary design recording unit for recording a 
supplementary design included in the separated control 
10 information in the supplementary design storage unit. 

With the above construction, the receiving apparatus 
receives control information including supplementary designs 
from the transmitting apparatus, obtains the supplementary 
designs from the control information, and stores them. The 
15 receiving apparatus then uses the stored supplementary 

designs when combining supplementary designs with the image 
data, so that a variety of supplementary designs can be used 
by the receiving apparatus . 

Here, the supplementary design storage unit may include 
20 a plurality of supplementary designs, the receiving 
apparatus may further include a supplementary design 
selecting unit for selecting one supplementary design from 
the plurality of supplementary designs stored by the 
supplementary design storage unit, in accordance with a user 
25 operation, and the supplementary design reading unit may 
read the selected supplementary design. 

With the above construction, the user can select 

12 



his/her desired supplementary designs. 

The above objects can also be achieved by a receiving 
method used in a receiving apparatus for an interactive 
communication system using a broadcast wave produced by 
multiplexing a plurality of frames of image data and control 
information including link information showing a link to 
another of the plurality of frames of image data and 
supplementary design combining information for each frame of 
image data indicating a combining of a supplementary design 
and the image data, the supplementary design being combined 
with an image represented by the image data, the receiving 
method including: a separating step for separating a frame 
of image data and corresponding control information from the 
broadcast wave; a supplementary design reading step for 
reading a supplementary design stored in a memory; a 
combining step for combining the read supplementary design 
and the image data; a storage step for storing the combined 
image data and the separated control information in a 
memory; a reproducing step for reproducing the image data 
stored in the memory to output an image signal; a operation 
step for receiving a user operation instruction to switch 
image data; a determining step' for determining image data 
indicated by the control information stored in a memory 
according to the operation instruction; and a second 
separating step for separating the determined image data and 
corresponding control information from the broadcast wave. 
The above object can also be achieved by a 




communication system which includes the transmitting 
apparatus and receiving apparatus described above. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects, advantages and features of the 
5 invention will become apparent from the following 
description thereof taken in conjunction with the 
accompanying drawings which illustrate a specific embodiment 
of the invention. In the drawings: 

Fig.l is a block diagram showing the structure of the 
10 data communication system 100 of the first embodiment of the 
present invention; 

Fig. 2 shows an example file list 200 stored in the file 
list storing unit 121; 

Fig. 3 shows the HTML document 301 "Report.html" which 
15 is the first page of a home page provided by a WWW server; 

Fig. 4 shows the image information 401 "Weather.gif" 
which is an image displayed on the first page of the home 
page; 

Fig. 5 shows the HTML document 501 "Tokyo.html" which is 
20 the second page of the home page; 

Fig. 6 shows the HTML document 601 "Osaka.html" which is 
the third page of the home page; 

Fig. 7 shows an example of the link information table 
700 stored in the data conversion table storing unit 122; 
25 Figs.SA to 8C show transmission data 800 for the first 

page of the WWW home page generated from the HTML document 

14 




301, audio information "Weather.au", and the image 
information 401; 

Figs.9A and 9B show transmission data 900 for the 
second page of the WWW home page generated from the HTML 
5 document 501; 

Figs.lOA and lOB show transmission data 1000 for the 
third page of the WWW document generated from the HTML 
document 601; 

Fig.llA shows the transmission method for used by the 
10 transmitting unit 116 for transmitting the transmission 
data; 

Fig.llB shows a multiplexed stream transmitted in 
digital satellite broadcasting; 

Fig. 12 is a flowchart showing an overview of the 
15 procedure of the data transmitting apparatus 110; 

Fig. 13 is a flowchart showing an example information 
obtaining procedure of the information obtaining unit 111; 

Fig. 14 is a flowchart showing an example procedure for 
generating transmission data by the transmission data 
20 generating unit 112; 

Fig. 15 is a flowchart showing a detailed example of the 
processing in step S1312 of Fi*g. 14; 

Fig. 16 shows an example of the cursor design 
correspondence table which the control unit 155 generates to 
25 control the display position of the cursor design; 

Fig. 17 shows an example of the design information 
stored by the control unit 155; 




Fig. 18 shows the display image 1800 which is the 
initial screen displayed by the display unit 154 based on 
the transmission data 800 shown in Figs. 8A to 8C; 

Fig. 19 shows the display image 1900 which is the 
5 initial screen displayed by the display unit 155 based on 
the transmission data 900 shown in Figs. 9A and 9B; 

Fig. 20 shows the display image 2000 which is the 
initial screen displayed on the display unit 154 for the 
transmission data 1000 shown in Figs. lOA and lOB; 
10 Fig. 21 is a flowchart showing an example procedure 

for display control which is performed by the control unit 
155; 

Fig. 22 is a block diagram showing the construction of 
the data communication system of the second embodiment of 
15 the present invention; 

Fig. 23 shows an example of the link information table 
which is the stored content of the data conversion table 
storing unit in the second embodiment; 

Figs.24A to 24C shows the transmission data for the 
20 first page of a WWW home page which has been generated from 
a HTML document and the audio information "Weather.au" 
according to the second embodiment; 

Fig. 25 is a flowchart showing an example of the 
processing by the transmission data generating unit for an 
25 "<H1>" tag in the second embodiment; 

Fig. 2 6 shows an example of the stored content of the 
design information storage unit in the second embodiment; 



Fig. 27 shows the display image for the first screen 
which is displayed in accordance with the transmission data 
shown in Figs. 24A to 24C; 

Fig. 28 is a block diagram showing the construction of 
the data communication system of the third embodiment of the 
present invention; and 

Figs.29A to 29C shows the transmission data for the 
first page of a WWW home page which has been generated from 
a HTML document and the audio information "Weather.au" 
according to the third embodiment. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
First Embodiment 

Fig.l is a block diagram showing the construction of 
the data communication system 100 which is described in the 
present embodiment. This data communication system 100 is 
composed of a data transmitting apparatus 110 and a 
plurality of data receiving apparatuses 150. 

The data transmitting apparatus 110 includes an 
information obtaining unit 111, a transmission data 
generating unit 112, a transmission data holding unit 113, 
a transmission data reading unit 114, a multiplexing unit 
115, and a transmitting unit 116, 

Each data receiving apparatus 150 includes a separating 
unit 151, a received data holding unit 152, a reproducing 
unit 153, a display unit 154, a control unit 155, a signal 
receiving unit 156, and an audio output unit 157. 
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Construction of the Information Obtaini ng Unit 111 

The information obtaining unit 111 includes a file list 
storing unit 121 and a buffer (not-illustrated) which holds 
information obtained from an external database, such as a 
5 WWW server. The file list storing unit 121 stores a file 
list 200 in which the file names of files that are to be 
obtained by the information obtaining unit 111 and the 
addresses of these files are stored corresponding to serial 
numbers which show the order in which the files are to be 
10 obtained. 

Fig. 2 shows an example of the file list 200 stored in 
the file list storing unit 121. In the file names given in 
this list, the extension "html" indicates that a file is an 
HTML document, the extension "gif" indicates that a file is 
15 an image which has been compressed according to GIF 

(Graphics Interchange Format), and the extension "au" 
indicates that a file is audio information in AU format. 

This file list 200 shown in Fig. 2 shows the case when 
the information obtaining unit 111 is connected to the 
20 Internet and obtains information from WWW servers. In this 
example, the file list 200 is a table in which the URL 
(Uniform Resource Locator) of a directory on a WWW server is 
stored in the address column 202 corresponding to each 
number in the serial number column 201. In the present 
25 example, each page in a home page provided by a WWW server 
can be composed of an HTML document and image files and 





audio files whose file names are indicated by the HTML 
document. As a result, the file name of the HTML document 
for each page is grouped together with the file names of the 
accompanying image information files and audio files in the 
5 file name column 203 of the file list 200. 

It should be noted that there can be cases when the 
address and file names stored in file list storing unit 121 
for each serial number in the file list do not need to be 
recorded separately, so that they may instead be represented 
. 10 using a single URL. It is also possible for files to be 
obtained not from a WWW server, but from an external 
database. In this case, the address of the file is 
expressed as the address of a device in the external 
database and the file is expressed by a file address in the 

15 database. 

The information obtaining unit 111 reads a URL and the 
file names which are to be obtained from the URL from the 
file list storing unit 121 in ascending order of the serial 
numbers in column 201. It then accesses the WWW server 

20 indicated by the URL to obtain the indicated files. The 
information obtaining unit 111 assigns file names to the 
obtained files and stores the 'files in the buffer. 

Examples of files 



The files obtained by the information obtaining unit 



25 



111 are described below, with reference to Figs. 3, 4, 5, and 



6. 
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Fig. 3 shows the HTML document 301 "Report.html" which 
is the first page of a home page provided by a WWW server. 
The notation 'HTML document 301 "Report.html"' indicates the 
file of HTML document 301 whose file name is "Report.html." 
5 In HTML documents, character strings written inside 

"<>" brackets are called tags. These tags represent control 
codes and are used in pairs written as "<character string>" 
and "</character string>". The control codes in tags 
indicate the execution of a corresponding control operation. 
10 Tags "<HTML>" on line 311 and "</HTML>" on line 323 in 

Fig. 3 indicate that the character strings between these tags 
form a single HTML document 301. 

Tags "<H1>" and "</Hl>" on line 312 indicate that the 
character string "WEATHER REPORT" between these tags is the 
15 headline of this document. 

Tags "<CENTER>" on line 313 and "</CENTER>" on line 315 
indicate that the part of the document expressed by the 
character strings between these tags should be centered. 

•<IMG SRC="Weather .gif ">' on line 314 indicates that 
20 the image information 401 "Weather.gif" shown in Fig. 4 is to 
be displayed in the document. Here, "SRC=" is an attribute 
of tag "<IMG>" and indicates ah image information file. The 
attribute content of "SRC=" is "Weather.gif", indicating a 
file name. 

25 Fig. 4 shows the image information 401 "Weather.gif" 

which is an image displayed on the first page of the home 
page. 




As shown in Fig. 4, the image information 401 stored in 
image information file "Weather.gif" is a map of Japan which 
includes weather information. 

Tags "<P>" on line 316 and "</P>" on line 317 indicate 
5 that the character string "TOMORROW, THE WHOLE OF JAPAN WILL 
ENJOY SPRINGLIKE WEATHER" between these tags is a single 
paragraph. 

Tags "<UL>" on line 318 and "</UL>" on line 322 
indicate that the display items expressed by the character 

10 strings between these tags are displayed as an itemized list 
without serial numbers. 

Each of the tags "<L1>" on lines 319 and 320 indicates 
that the character string between this tag and the next 
"<L1>" or "</UL>" forms an item in the itemized list. 

15 '<A HREF=" Tokyo. html "> TOKYO </A>^ on line 319 of Fig. 3 

indicates that the character string "TOKYO" is linked to the 
HTML document 501 "Tokyo.html" which is shown in Fig, 5. 
Here, character strings or images which are linked to other 
files, such as this character string "TOKYO", are called hot 

20 spots or anchor points. As one example, if a user uses the 
mouse to select the hot spot "TOKYO" which displayed on a 
computer monitor by a browser,' the HTML document 501 
"Tokyo.html" will be read by the browser and is displayed on 
the screen. Here, the attribute of tag "<A>", "HREF=", 

25 represents a link destination, and the attribute content of 
"HREF=", in this case "Tokyo.html", indicates a file name 
for the link destination file. 




'<A HREF-"Osaka.html"> OSAKA </A>' on line 320 of Fig. 3 
indicates that the character string "OSAKA" is linked to the 
HTML document 601 "Osaka.html" which is shown in Fig. 5. 
Accordingly, this character string "OSAKA" is also a hot 
5 spot. If hot spot "OSAKA" is selected, HTML document 601 
"Osaka.html" will be displayed on the screen. 

•<A HREF="Weather.au"> AUDIO INFORMATION </A>' on line 
321 of Fig. 3 indicates that the character string "AUDIO 
INFORMATION" is linked to the audio file "Weather.au.", 
10 making it another hot spot. If the hot spot "AUDIO 

INFORMATION" is selected, the audio file "Weather.au." will 
be reproduced. 

Fig. 5 shows the HTML document 501 "Tokyo.html" which is 
the second page of the home page. The tags included in the 
15 HTML document 501 have already been explained, so that the 

following explanation will only deal with the links to other 
pages . 

^<A HREF="Report.html"> RETURN </A>' on line 511 of 
Fig. 5 indicates that the character string "RETURN" is linked 
20 to the HTML document 301 "Report.html" which is shown in 
Fig. 3. 

Fig. 6 shows the HTML document 601 "Osaka.html" which is 
the third page of the home page. 

'<A HREF="Report.html"> RETURN </A>' on line 611 of 
25 Fig. 6 indicates that the character string "RETURN" is linked 
to the HTML document 301 "Report.html" which is shown in 
Fig. 3. 




The information obtaining unit 111 may obtain all the 
files listed in the file list 200 in order and store all of 
the obtained files in its buffer. Alternatively, the 
information obtaining unit 111 may obtain the listed files 
5 in units of one page and store the obtained files in the 

buffer. In this latter case, the files for a next page are 
only obtained after the processing of a current page has 
been completed by the transmission data generating unit 112. 

Construction of Transmission Data Generating Unit 112 

10 The transmission data generating unit 112 includes a 

data conversion table storing unit 122 and a storage area 
(not shown in the drawings) which is used as the work area 
for generating transmission data. The data conversion table 
storing unit 122 includes a tag table, font files, and a 

15 link information table. The tag table is a list of control 
operations for every available HTML tag which each has its 
own flag. The font files each include character fonts for 
TV display which are classified for different purposes. The 
link information table is a table which expresses the link 

20 information for hot spots in a format recognized by the data 
communication system 100. The* work area is composed of a 
file storage area, a tag storage area, a character string 
storage area, and a flag storage area. The file storage 
area stores one HTML document file. The tag storage area 

25 stores the character strings which are written inside the "< 
>" brackets of each tag. The character string storage area 




stores character strings other than the ones between the "< 
>" brackets. The flag storage area is an area where flags 
which are used for controlling the generation of display 
image information for one frame of image data are set. The 
5 character strings stored in the tag storage area and the 

character string storage area are deleted when the control 
operations corresponding to the tags (flags) have been 
completed. If a plurality of flags are present in the flag 
storage area, the flags are set in ascending order and are 
10 reset in descending order. 

Fig ,7 shows an example of the link information table 

700 stored in the data conversion table storing unit 122, 
where the numbers, such as "9", are decimal values. 

As shown in Fig. 7, the link information stored in the 
15 link information table 700 is composed of index information 

701 and hot spot information 702. 

Index information 701 is composed of an information 
identification part "INDEX=" for identifying the information 
as index information and a file identification number 

20 expressed as a four-figure decimal value. This file 

identification number is the identification number of a 
transmission data file which includes the current piece of 
index information 701. 

Hot spot information 702 is composed of an information 

25 identification part "HOTSPOT==" for identifying the 

information as hot spot information, X-Y coordinates 
"X=999, Y=999", for indicating a cursor position in the 




current display screen, an instruction "GO_TO_PAGE" which 
corresponds to the cursor position given by these 
coordinates, and a four-figure decimal variable showing the 
identification number of the transmission file linked to 
5 this cursor position. 

The transmission data generating unit 112 treats one 
set of the display image information to be generated along 
with the accompanying audio information and link information 
as a single transmission data file, based on one HTML 

10 document. Here, the transmission data generating unit 112 
establishes a storage area in each of the display image 
information storing unit 123, the audio information storing 
unit 124, and the link information storing unit 125 which 
are provided in the transmission data holding unit 113 

15 (described later) so that the display image information, 
audio information, and link information to be included in 
one transmission data file are interrelatedly stored. 
Hereinafter, the storage areas in the display image 
information storing unit 123, the audio information storing 

20 unit 124, and the link information storing unit 125 are 

respectively called the display image information storage 
area, the audio information storage area, and the link 
information storage area. 

The transmission data generating unit 112 assigns a 

25 same identification number to the display image information 
storage area, the audio information storage area, and the 
link information storage area used for storing the 



corresponding kinds of information in a same transmission 
data file. Here, the transmission data generating unit 112 
manages the audio information and link information in a same 
transmission data file as separate files which are given the 
same identification number. This identification number may 
correspond to the serial number in column 201 of the file 
list, which in turn corresponds to the file names of the 
present files which are given in column 203. 

The transmission data generating unit 112 fetches an 
unprocessed HTML document file which has been obtained by 
information obtaining unit 111 from the buffer in the 
information obtaining unit 111 in accordance with the serial 
number 201 in the file list 200. The transmission data 
generating unit 112 then writes the file into the file 
storage area of the work area, in addition to generating the 
index information in accordance with the format of the index 
information 701 of the link information table 700. This 
generated index information is then stored at the front of 
the link information storage area in the transmission data 
holding unit 113. 

The transmission data generating unit 112 reads the 
tags in order from the start o'f the HTML document and 
interprets the tags by looking each tag up in the tag table 
to find the corresponding control operations. This 
interpretation of control operation is performed by writing 
a character string detected after a tag start sign "<" one 
character at a time into the tag storage area provided in 
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the work area until a tag end sign is detected. The 

transmission data generating unit 112 then matches the 
character string in the tag storage area with a tag written 
in the tag table. 
5 For tags which are not "<A>", "<IMG>", or "<character 

string preceded by V>", the transmission data generating 
unit 112 sets a flag showing the interpreted control 
operation in the flag storage area provided in the work area 
and stores the character strings between the start tag "<>" 

10 and the corresponding end tag "</>" into the character 

string storage area in the work area so as to correspond to 
the set flag. The storage of character strings between a 
pair of corresponding tags is performed in the same way as 
the storage of the character strings included inside the 

15 tags themselves. The transmission data generating unit 112 
converts the character strings in the character string 
storage area into text image using the fonts in one of the 
font files and arranges the text image in accordance with 
the control operation represented by the current flag to 

20 generate display image information. This generated display 
image information is then added to the display image 
information storage area provided in the transmission data 
holding unit 113. Here, when a start tag "<character 
string>" is followed, not by a character string, but by 

25 another start tag "<another character string>", a flag is 
first set for the former tag in the flag storage area, 
before the processing is performed for the control operation 
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indicated by the latter tag. 

If the read tag is "<IiyiG>", the transmission data 
generating unit 112 fetches the image information file with 
the file name specified by the attribute "SRC=" from the 
5 buffer of the information obtaining unit 111, and 

decompresses the image information file under the format 
specified by the file name extension to convert the format 
of the image into an appropriate image data format, such as 
bitmap data or graphics data. 

10 If, for example, the file name extension is ".gif", the 

transmission data generating unit 112 decompresses the image 
information file under GIF to convert the image information 
file into the appropriate format. If a preceding flag is 
set for a control operation to be performed on the converted 

15 image, the converted image is arranged in accordance with 
this control operation to generate display image 
information, otherwise the display image information is 
generated with the converted image being arranged in 
accordance with an initial setting. This generated display 

20 image information is then added to the display image 
information storage area. 

If the read tag is "<A>"; the transmission data 
generating unit 112 checks to see if the "link destination 
file" specified by attribute "HREF=" of "<A>" is an audio 

25 file which has a file name extension, such as "au", which 
indicates audio information. If the link destination file 
is an audio file, the transmission data generating unit 112 




fetches the audio file from the buffer of the information 
obtaining unit 111 and converts the audio information into 
audio data of a predetermined format, before storing it in 
the audio information storage area. 

If the link destination file is not an audio file, the 
transmission data generating unit 112 generates a text image 
for the character string between tags <A> and </A>, and 
arranges the text image at a display position indicated by a 
preceding flag, or alternatively at a display position 
specified by an initial setting, with a space being reserved 
for displaying a cursor. By doing so, the transmission data 
generating unit 112 generates display image information 
which is then added to the display image information storage 
area provided in the transmission data holding unit 113. 
The transmission data generating unit 112 then calculates 
the X-Y coordinates for the space reserved for the cursor 
display position and refers to the hot spot information 702 
in the link information table 700 to generate hot spot 
information from the calculated X-Y coordinates and the 
"link destination file name" specified by the attribute 
"HREF=" of tag "<A>". In doing so, the transmission data 
generating unit 112 refers to the file list 200 and finds 
the serial number 201 corresponding to the file name in 
column 203 which in turn corresponds to the link destination 
file name of tag "<A>", before writing this serial number 
201 into the hot spot information as the file identification 
number. If the link destination file name is not present in 
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the file list 200, the transmission data generating unit 112 
writes the file name of the current file into the hot spot 
information. After doing so, the transmission data 
generating unit 112 adds the generated hot spot information 
to the link information storage area provided in the 
transmission data holding unit 113* 

After completing all the above processes for an HTML 
document, the transmission data generating unit 112 writes a 
graphic representation of the identification number of the 
display image information area at a predetermined position 
in the non-displayed area of the display image information 
stored in the display image information area. In the 
present embodiment, the identification number has been 
described as being a four-figure decimal value, although the 
number of decimal digits is not limited to four. The 
identification number may alternatively be represented in 
binary notation, as a combination of numerals, characters 
and symbols, as a graphical figure, as a bar code, or even 
as a file name. Here, the audio information stored in the 
audio information storage area and the link information 
stored in the link information storage area are also 
appended with the identification numbers of the 
corresponding storage areas, in the same way as with 
standard digital data files. 

Through the processes described above, the transmission 
data generating unit 112 generates a first, second, and 
third page of transmission data 800, 900, and 1000, which 
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are respectively the first, second, and third pages of the 
home page provided by the WWW server, from the HTML document 
301, the audio information not shown in the drawings, the 
image information 401, the HTML document 501, and the HTML 
5 document 601. 

Transmission Data Generated by 

The Transmission Data Generating Unit 112 
Figs.SA to 8C show the transmission data 800 that is 
the first page of the home page provided by the WWW server. 

10 This first page of transmission data 800 has been generated 
from the HTML document 301, the audio information 
"Weather.au," and the image information 401. Figs.9A and 9B 
show the transmission data 900 that is the second page of 
the home page provided by the WWW server which has been 

15 generated from the HTML document 501. Figs.lOA and lOB show 
the third page of transmission data 1000 that is the third 
page of the home page which has been generated from the HTML 
document 601. As shown in Figs.8A to 8C, the transmission 
data 800 includes the display image information 801, the 

20 audio information 802, and the link information 803 which is 
related to display image inforiaation 801. Here, Fig.8A 
shows the display image which is the content of the display 
image information 801 , Fig.SB shows a representation of the 
content of the audio information 802, and Fig.SC shows the 

25 content of the link information 803. 

In Fig,8A, the area surrounded by the dotted line above 
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the display image information 801 is a non-displayed area 
which is provided in each set of display image information* 
As its name suggests, this non-displayed area is not 
displayed on the screen of the display unit 154. An image 
5 of an identification number, such as "0001" shown in the 
drawing, is written into the top-right corner of the non- 
displayed area by the transmission data generating unit 112. 
The displayed area of display image information 801 is one 
display image which is composed of an image which was 

10 originally expressed as image information and character 
strings which have been converted from the original 
character code files into images. 

The audio information 802 is linked to the character 
string "AUDIO INFORMATION" which is a hot spot in the HTML 

15 document 301. Here, the file which includes the audio 
information 802 is also given the identification number 
"0001", as shown in Fig.8B. 

The file storing the link information 803 is also given 
the identification number "0001", as shown in Fig.SC. This 

20 link information 803 is used for control purposes, and is 
not displayed. "<INDEX=0001>" on line 811 of the link 
information 803 is the index information which indicates 
that the file identification number of the transmission data 
800 is "0001". 

25 The character string on line 812 indicates that 

instruction "GO„TO__PAGE (0002) " is related to a position in 
display image information 801 which is specified by the 



coordinates (100,600) and that a cursor image held by the 
data receiving apparatus 150 should be displayed at this 
position. Instruction "GO_TO_PAGE (0002) " indicates that a 
page having identification number "0002", which in this case 
corresponds to the transmission data 900, should be 
displayed. 

The character string on line 813 indicates that the 
instruction "GO_TO_PAGE (0003) " is related to a position in 
the display image information 801 specified by the 
coordinates (100,700) and that a cursor image held by the 
data receiving apparatus 150 should be displayed at this 
position. This instruction "GO_TO_PAGE (0003) " indicates 
that a page having identification number "0003", which in 
this case corresponds to the transmission data 1000, should 
be displayed. 

Figs,9A and 9B show the transmission data 900 which is 
the second page of the home page provided by the WWW server. 
This transmission data 900 includes the display image 
information 901 and the link information 902, which is 
related to the display image information 901. Here, Fig.9A 
shows the display image which is the content of the display 
image information 901 and Fig.9B shows the content of the 
link information 902. 

As shown in Fig.9A, an image of the identification 
number "0002" is written in the top-right corner of the non- 
displayed area of the display image information 901 which is 
shown by the dotted line, in the same way as with the 
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display image information 801. 

As shown in Fig.9B, the file storing link information 
902 is given the identification number "0002". 

In Fig.9B, <INDEX-0002> on line 911 is the index 
information, indicating that the file identification number 
for transmission data 900 is "0002". 

The character string on line 912 indicates that the 
instruction "GO_TO„PAGE (0001) " is related to a position in 
the display image information 901 specified by coordinates 
(050,400) and that a cursor image held by the data receiving 
apparatus 150 should be displayed at this position. This 
instruction "GO_TO__PAGE (0001) " indicates that a page having 
identification number "0001," which in this case corresponds 
to the transmission data 800, should be displayed. 

Fig.lOA and lOB show the transmission data 1000 which 
is the third page of the home page provided by the WWW 
server. Transmission data 1000 includes display image 
information 1001 and link information 1002, which is related 
to display image information 1001. Here, Fig.lOA shows the 
display image which is the content of the display image 
information 1001 and Fig.lOB shows the content of the link 
information 1002. 

As before, an image of the identification number "0003" 
is written into the top-right corner of the non-displayed 
area of display image information 1001. 

As shown in Fig.lOB, the file storing link information 
1002 is given the identification number "0003". 
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"<INDEX=0003>" on line 1011 of the link information 
1002 is the index information^ indicating that the 
identification number of the files of the transmission data 
1000 is "0003". 

5 The character string on line 1012 indicates that the 

instruction "GO_TO_PAGE (0001) " is related to a position in 
the display image information 901 specified by the 
coordinates (050,400) and that a cursor image should be 
displayed at this position. This instruction "GO_TO 
10 PAGE (0001)" indicates that a page having identification 
number "0001", which in this case corresponds to 
transmission data 800, should be displayed. 

Illustrative Example of the Processing 

by the Information Obtaining Unit 111 
15 and the Transmission Data Generating Unit 112 

The following is a specific example of the processing 
performed by the information obtaining unit 111 and the 
transmission data generating unit 112 in which the files 
shown in Figs. 3, 4, 5^ and 6 are obtained and are used to 
20 generate the transmission data shown in Figs. 8, 9, and 10. 

Processing by the Information Obtaining Unit 111 

The information obtaining unit 111 first refers to the 
file list storing unit 121 and issues a connection request 
to the indicated WWW server on the Internet. The 
25 information obtaining unit 111 then obtains the HTML 




document 301 "Report.html" from this WWW server, assigns it 
the file name "Report.html", and stores the file in the 
buffer. The information obtaining unit 111 also obtains the 
compressed image information 401, the HTML document 501, and 
5 the HTML document 601 in the same way from the WWW server. 

Processing by the Transmission Data Generating Unit 112 

The transmission data generating unit 112 allocates 
storage areas in the transmission data holding unit 113 for 
respectively storing the display image information 801, the 

10 audio information 802, and the link information 803 which 
compose the transmission data 800. In doing so, the 
transmission data generating unit 112 assigns the 
identification number "0001" for retrieving transmission 
data 800 to these storage areas. The transmission data 

15 generating unit 112 then fetches the (yet-unprocessed) HTML 
document 301 from the buffer of the information obtaining 
unit 111 and writes this document into the file storage area 
in the work area. 

The transmission data generating unit 112 then 

20 generates the index information "<INDEX=0001>" shown in line 
811 of the transmission data 800 for the first page of the 
WWW home page from the file name "Report.html" of HTML 
document 301, before storing the generated index information 
at the start of the link information storage area for link 

25 information 803 wh'ich is provided in the transmission data 
holding unit 113. 




The transmission data generating unit 112 then reads 
the tag "<HTML>" from line 311 in the HTML document 301 and 
stores the character string "HTML" in the "<HTML>" tag in 
the tag storage area of the work area. It then refers to 
5 the tag table stored in the data conversion table storing 
unit 122 to interpret the tag, and by doing so recognizes 
that line 311 is the first line of the HTML document 301. 
After doing so, it deletes the character string "HTML" from 
the tag storage area. 

10 Next, the transmission data generating unit 112 reads 

the tag "<H1>" on line 312 and refers to the tag table to 
interpret its content. On doing so, it sets the headline 
flag in the flag storage area in the work area. Here, the 
headline flag shows that the character string following the 

15 "<H1>" tag is a headline and so should be displayed using a 
headline font. The characters in the character string after 
the "<H1>" tag are then written one character at a time into 
the character string storage area until the "</Hl>" tag 
appears, which in the present case results in the character 

20 string "WEATHER REPORT" being written into the character 

string storage area and being converted into display image 
information using the headline* font. This generated display 
image information is then added to the display image 
information storage area set in the transmission data 

25 holding unit 113. After this, the headline flag in the work 
area is reset, the character string "WEATHER REPORT" is 
deleted from the character string storage area, and the 




character string "HI" is deleted from the tag storage area. 
Next, the transmission data generating unit 112 reads 
the tag "<CENTER>" on line 313 and sets the centering flag 
in the work area. The centering flag shows that the 
5 character string which follows the corresponding tag is to 
be centered on the display. Here, there is no character 
string following the "<CENTER>" tag which can be centered, 
so that the transmission data generating unit 112 continues 
by reading line 314. 

10 The transmission data generating unit 112 reads the tag 

'<IMG SRC="Weather .gif on line 314 and refers to the tag 
table to interpret the content of the tag. The transmission 
data generating unit 112 then investigates whether the file 
for the image information 401, which is expressed by the 

15 file name "Weather.gif", is present in the buffer of the 

information obtaining unit 111, and, since this is the case, 
reads the file. The transmission data generating unit 112 
then converts the image information 401 which is stored and 
compressed in the read file into a bitmap image or other 

20 such format, in accordance with a GIF decompression method. 

The transmission data generating unit 112 then reads 
the tag "</CENTER>" on line 315 and arranges the bitmap 
image converted from image information 401 in accordance 
with the centering flag set in the work area. The display 

25 image information thus generated is then added to the 

display image information storage area in the transmission 
data holding unit 113, before the centering flag in the work 




area is reset. 

The transmission data generating unit 112 then reads 
the "<P>" tag on line 316 and sets the paragraph flag. The 
paragraph flag shows that the character strings displayed 
5 between this start tag and the "</P" end tag should be 

displayed as a single paragraph which is to be inserted into 
the following blank line. As with "WEATHER REPORT" on line 
312, the character string "TOMORROW, THE WHOLE OF JAPAN WILL 
ENJOY SPRINGLIKE WEATHER" between these tags is read and is 
10 stored in the character string storage area in the work 

area. Next, after reading the "</P>" tag, the transmission 
data generating unit 112 converts the character string 
"TOMORROW, THE WHOLE OF JAPAN WILL ENJOY SPRINGLIKE WEATHER" 
into an image using the font for paragraph display which is 
15 stored as one of the font files and adds the generated 
display image information to the storage area in the 
transmission data holding unit 113 for display image 
information storage area 801. After this, the content of 
the work area is cleared as before. 
20 The transmission data generating unit 112 next reads 

the tag "<UL>" on line 318, interprets it, and sets the 
itemized list flag in the work* area. The itemized list flag 
shows that each character string which follows the tag and 
is interpreted as one item should be displayed as a non- 
25 numbered item in a list. 

The transmission data generating unit 112 next reads 
the tag "<L1>" on line 319, refers to the tag table. 




interprets the tag as indicating the start of one item in a 
list, and sets the item flag in the flag storage area. The 
item flag shows that the display position on the display 
screen should be shifted to the next line every time an 
5 "<L1>" or "</Ll>" tag is read. 

The transmission data generating unit 112 reads the tag 
"<A HREF="Tokyo.html>" following the tag "<L1>" and writes 
it into the tag storage area. The transmission data 
generating unit 112 then interprets this tag "<A 

10 HREF="Tokyo.html>" and sets the link flag in the flag 
storage area. 

When the extension of the file name given as the 
attribute of the "<A>" tag indicates audio information, the 
link flag shows that processing for the audio information is 

15 to be performed so that the audio information is converted 
into a predetermined format and stored in the audio 
information storage area. When the extension of the file 
name given as the attribute of the "<A>" tag does not 
indicate audio information, the link flag shows that the 

20 character string between the "<A>" and "</A>" tags which is 
appended with the link by the "<A>" tags is to be converted 
into an image with a two-character space provided before it 
as a cursor display area. The link flag also shows that 
display image information is to be generated for this 

25 character string in addition to hot spot information which 
is generated in accordance with the format of the hot spot 
information 702. 




The transmission data generating unit 112 reads the 
character string "TOKYO" between the "<A HREF="Tokyo.html>" 
and "</A>" tags and writes it into the character string 
storage area. After reading the "</A>" tag, the 
5 transmission data generating unit 112 converts the character 
string "TOKYO" into an image with a two-character space 
provided before it as a cursor display area and arranges the 
character string in accordance with the itemized list flag 
to generate display image information which it adds to the 

10 display image information storage area provided in the 

transmission data holding unit 113. The transmission data 
generating unit 112 then calculates the coordinates of the 
cursor display position as (100,600), and uses these 
coordinates and the attribute "Tokyo.html" stored in the tag 

15 storage area of the work area to generate the hot spot 

information shown on line 812 of Fig. 8. After doing so, the 
transmission data generating unit 112 adds the generated hot 
spot information to the link information storage area 
provided in the transmission data holding unit 113. Having 

20 done so, the transmission data generating unit 112 deletes 

the character string "A HREF="Tokyo.html" in the tag storage 
area of the work area and the character string "TOKYO" in 
the character string storage area, in addition to resetting 
the link flag. 

25 Next, on reading the "<L1>" tag on line 320, the 

transmission data generating unit 112 shifts the display 
position for the next display image to the following line in 




accordance with the item flag, and, in the same way as with 
line 319, generates display image information for the 
character string "OSAKA", in addition to generating the hot 
spot information shown on line 813 of Fig.SC. The generated 
5 display image information is then added to the display image 
information storage area provided in the transmission data 
holding unit 113 and the generated hot spot information is 
added to the link information storage area. After this, the 
transmission data generating unit 112 deletes the character 

10 string "A HREF=" Osaka .html" and the character string 
"OSAKA", and resets the link flag. 

Next, on reading the "<L1>" tag on line 321, the 
transmission data generating unit 112 shifts the display 
position for the next display image to the following line in 

15 accordance with the item flag, and sets the link flag in 
accordance with the tag "A HREF="Weather . au" . On 
investigating the file name extension of the attribute in 
accordance with the link flag, the transmission data 
generating unit 112 finds that the link destination file is 

20 audio information in AU format, so that it converts the AU 
format audio information into audio information of a 
predetermined format, before storing the converted audio 
information in the audio information storage area provided 
in the transmission data holding unit 113. 

25 Next, on reading the "</Ll>" tag on line 322, the 

transmission data generating unit 112 interprets that the 
itemized list is complete, and resets the itemized list flag 
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and the item flag. 

Finally, on reading the "</HTML>" tag on line 323, the 
transmission data generating unit 112 interprets that the 
HTML document 301 has ended,, and so terminates the 
5 generation process for transmission data 800. 

Following this, the transmission data generating unit 
112 finds that there is an unprocessed HTML document 501 and 
so sets a display image information storage area for display 
image information 901 and a link information storage area 

10 for link information 902 in the transmission data holding 

unit 113 for storing the composite parts of the transmission 
data 900, in doing so giving both storage areas the 
identification number "0002" for the retrieval of the 
transmission data 900. It then reads the unprocessed HTML 

15 document 501 from the buffer of the information obtaining 
unit 111 and writes it into the work area. 

The transmission data generating unit 112 then 
generates the index information "<INDEX=0002>" shown in line 
911 of the transmission data 900 which displays the second 

20 page of the WWW home page from the file name "Tokyo.html" of 
the HTML document 501, before storing the generated index 
information at the start of the link information storage 
area for the link information 902 which is provided in the 
transmission data holding unit 113, In the same way as with 

25 the generation of the transmission data 8 00 from the HTML 

document 301 and the image information 401, the transmission 
data generating unit 112 then generates the transmission 




data 900 from the HTML document 501 and the transmission 
data 1000 from the HTML document 601, with no further 
explanation of this process being given. 

Construction of the Transmission Data Holding Unit 113, the 
5 Transmission Data Reading Unit 114^ the Multiplexing Unit 
115 f and the Transmitting Unit 116 

The transmission data holding unit 113 includes a 
display image information storing unit 123, an audio 
information storing unit 124, and a link information storing 
10 unit 125, with simultaneous retrieval from these units being 
possible . 

The display image information storing unit 123 can be 
realized by RAM (Random Access Memory) or a hard disk 
device, and is provided with a plurality of display image 

15 information storage areas which are set by the transmission 
data generating unit 112. Each of these display image 
information storage areas stores one file of display image 
information which is generated by the transmission data 
generating unit 112. 

20 The audio information storing unit 124 can also be 

realized by RAM (Random Access * Memory) or a hard disk 
device, and is provided with a plurality of audio 
information storage areas which are set by the transmission 
data generating unit 112. Each of these audio information 

25 storage areas stores one file of audio information which is 
generated by the transmission data generating unit 112. 



The link information storing unit 125 can also be 
realized by RAM (Random Access Memory) or a hard disk 
device, and is provided with a plurality of link information 
storage areas which are set by the transmission data 
generating unit 112. Each of these link information storage 
areas stores one file of link information which is generated 
by the transmission data generating unit 112 • 

The transmission data reading unit 114 simultaneously 
reads the display image information, the audio information, 
and the link information in a same transmission data file 
from the storage areas provided in the transmission data 
holding unit 113 in the order of the file identification 
numbers for the transmission data, and outputs the read 
information to the multiplexing unit 115. After reading the 
files for the transmission data which has the final 
identification number, the transmission data reading unit 
114 returns to the transmission data with the identification 
number "0001" and once again reads the transmission data in 
the order of the identification numbers. This is to say, 
the transmission data reading unit 114 cyclically reads the 
transmission data from the transmission data holding unit 

113 in order of identification' numbers and outputs the 
transmission data to the multiplexing unit 115. In doing 
so, there is the following difference in the reading method 
when audio information is or is not present. When no audio 
information is present, the transmission data reading unit 

114 advances to the reading of a set of transmission data 
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with the next identification number after reading a first 
set of transmission data once. When audio information is 
present;, the transmission data reading unit 114 reads the 
audio information and advances to the reading of a set of 
5 transmission data with the next identification number only 
after reading the display image information and the link 
information a plurality of times for the period which is 
required by the reproduction of the audio information. As 
one example, if the audio information has a reproduction 

10 period of two seconds, the transmission data reading unit 

114 will read the audio information once, and will read the 
display image information and link information 60 times (30 
frames per second * 2 seconds) , before advancing to the 
reading of a set transmission data with the next 

15 identification number. In this way, the transmission time 
for audio information can be maintained. 

The multiplexing unit 115 multiplexes the display image 
information (including the audio information) and the link 
information read by the transmission data reading unit 114, 

20 and outputs multiplexed data to the transmitting unit 116. 
Here, this multiplexing can be performed using the same 
method as conventional teletext broadcasting. In such a 
case, display image information and audio information are 
multiplexed in the same way as the images and audio included 

25 in conventional TV broadcasts, while link information is 
multiplexed in the same way as the text information 
multiplexed with teletext broadcasts . This is to say, when 



no audio information is present, the display image 
information is transmitted in the image section of one frame 
of the television image signal, while the link information 
is transmitted -in the retrace section of the same one frame 
5 of the television image signal. When audio information is 
present, the audio information is transmitted as the 
television audio signal, while the corresponding display 
image information and link information are transmitted in 
the image area and retrace area, respectively, of the 
10 television image signal for the number of frames required by 
the reproduction of the audio information. 

The transmitting unit 116 successively transmits the 
transmission data which has been multiplexed by the 
multiplexing unit 115 on a TV broadcast ground wave. 

15 Transmission Method for the Transmission Data 

Fig.llA gives a graphic representation of the 
transmission method used by the transmitting unit 116. 
Fig.llA shows the case when n pages (n being a positive 
integer) of transmission data are generated by the 

20 transmission data generating unit 112. In Fig.llA, a 

pairing of audio information atid display image information 
with a same identification number is expressed as one 
transmission unit corresponding to a normal TV broadcast, 
and the link information for the same identification number 

25 is expressed as one transmission unit corresponding to the 
text information which is multiplexed into a standard 




teletext broadcast. 

As shown in Fig.llA, in addition to being identified by 
the same identification number, the display image 
information, audio information, and link information stored 
5 in one transmission data file are transmitted at a 

corresponding time. Also, the transmission data from the 
first to the n^^ page in the transmission data holding unit 
113 are cyclically transmitted in the order of 
identification numbers. 

10 It should be noted here that while the transmission 

data reading unit 114 has been described as reading the 
display image information, the audio information, and the 
link information stored in the same transmission data file 
simultaneously from the display image information storing 

15 unit 123, the audio information storing unit 124, and the 
link information storing unit 125 and as having the read 
display image information, audio information, and link 
information transmitted with related identification numbers 
and transmission timing, the display image information and 

20 the link information do not need to be transmitted with a 
related timing. As one example, the transmission data 
reading unit 114 may instead be composed of a first reading 
unit and a second reading unit- Here, the first reading 
unit is constructed to continuously read pairs of display 

25 image information from the display image information storing 
unit 123 and audio information from the audio information 
storing unit 124 which it then outputs to the multiplexing 




unit 115. The second reading unit is constructed to 
continuously read only the link information from the link 
information storing unit 125 which it then outputs to the 
multiplexing unit 115. By doing so, the display image 
5 information and link information belonging to a same 

transmission data file do not need to be transmitted by the 
transmitting unit 116 at the same time, since the data 
receiving apparatus 150 can use the identification niimber 
commonly given to the display image information and the link 

10 information to recombine pairs of the display image 
information and the link information. 

The multiplexing unit 115 has also been described as 
multiplexing the display image information (including the 
audio information) and the link information which are 

15 generated by the transmission data generating unit 112, with 
the transmitting unit 116 transmitting the transmission data 
which has been multiplexed by the multiplexing unit 115 on a 
TV broadcast ground wave, although the display image 
information and link information do not need to be 

20 multiplexed together for transmission. As one example, the 
display image information and the audio information may be 
transmitted on a TV broadcast ground wave or as a digital 
satellite broadcast, while the link information may be 
transmitted using a telephone link and modem, or the like. 

25 Transmission here may alternatively be performed using 
multiple channels. 

When digital satellite broadcasting is used as the data 
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transmission method, compression/encryption and multiplexing 
may be performed according to MPEG2 (Moving Pictures Experts 
Group) video standard and system standard, so that display 
image information may be set as I pictures, with the audio 
5 information and link information being set as private 

information. Here, when it is possible for the display 
image information, audio information, and link information 
to be transmitted as digital data, it is no longer necessary 
to write a graphic representation of the identification 

10 number into the non-displayed area of the display image 

information, so that the identification number can be simply 
appended to the display image information and audio 
information, in the same way as with the link information. 
Incidentally, a detailed description of MPEG2 standard is 

15 given in "Saishin MPEG Kyoukasho [Latest MPEG Reader] " 
published by ASCII Publishing, Inc. 

Fig.llB shows the multiplexed stream which is 
transmitted when digital satellite broadcasting is used. 
The upper part of this drawing shows a transport stream 

20 under MPEG2 standard which has been generated by the 
multiplexing unit 115. 

The symbols "VI, Al, LI" in the transport stream 
represent the display image information, audio information, 
and link information which have the identification number 

25 "0001" and which are read from the transmission data file 
and multiplexed together. This is also the case for "V2, 
A2, L2" ... "Vn, An, Ln". 



"VI" is a video elementary stream which shows the 
display image information which has been converted into I 
(Intra) pictures under MPEG2 standard, with the PID (Packet 
IDentifier) "0x0100" having been attached to identify the 
stream. This is also the case for "V2" ... "Vn". 

"Al" is an audio elementary stream which shows the 
audio information which has been converted under MPEG2 
standard, with the PID "0x0101" having been attached to 
identify the stream. This is also the case for "A2" 
"An" . 

"LI - Ln" are private sections according to MPEG2 
standard for attaching each set of link information, with 
the PID "OxBO" having been attached to identify these as 
private sections. Here, identification numbers are also set 
in the table ID extensions to identify separate sets of link 
information. Each of these sets of link information is set 
at least one pairing of one part of the image area of the 
corresponding display image and information showing a link 
to another display image. As one example, in "LI", the 
display area centered on the coordinates (X, Y) = (100, 600) is 
set the link "GOTO_PAGE (0002) " representing a link to the 
display image with the identification number "0002", while 
the display area centered on the coordinates (X, Y) = (100, 700) 
is set the link "GOTO_PAGE (0003) " representing a link to the 
display image with the identification number "0003". 

The correspondence between the PIDs described above and 
the identification numbers is set according to the PMT 



(Program Map Table) under MPEG2 standard. Here, the 
correspondence between the PIDs and the identification 
nuinbers can be written in the descriptors of the private 
sections, such as by setting the identification numbers as 
the component tags in the PMT, as shown in Fig. 1 IB. 

In the above case, the video elementary stream, audio 
elementary stream, and private sections are generated by the 
transmission data generating unit 112 and are stored in the 
transmission data holding unit 113. Here, a set of one 
video elementary stream, one audio elementary stream, and 
one private section stored in the transmission data holding 
unit 113 corresponds to one transmission data file. Here, 
the video elementary stream, audio elementary stream, and 
private section stored as one set in the transmission data 
holding unit 113 are each read once, with the transmission 
data reading unit 114 cyclically reading all of the 
transmission data files. Using this data, transport streams 
are generated by the multiplexing unit 115. 

As described above, by multiplexing n sets of display 
image information, audio information, and link information 
with a PMT in the transport stream, transmission data can be 
easily transmitted using digital satellite broadcasting. 

Overview of the Proc f^dnre of the 

Data Transmitting Appa ratus 110 
The following is a detailed explanation of the 
procedure of the data transmitting apparatus 110, with 
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reference to Figs. 12 to 14. 

Fig. 12 is a flowchart showing an overview of the 
procedure of the data transmitting apparatus 110. 

The information obtaining unit 111 obtains a desired 
set of information from an external database and stores it 
in its internal buffer (step SllOl) . 

The transmission data generating unit 112 interprets 
the information obtained by the information obtaining unit 
111 and generates display image information, audio 
information, and link information, which it stores in the 
transmission data holding unit 113 (step S1102) . 

The transmission data reading unit 114 successively 
reads the transmission data from the transmission data 
holding unit 113 in order of identification numbers (step 
S1103) . 

The multiplexing unit 115 multiplexes the display image 
information (including the audio information) with the link 
information, and the transmitting unit 116 transmits the 
multiplexed transmission data using a television broadcast 
ground wave. 

Procedure of the Information Obtaining Unit 111 

Fig. 13 is a flowchart showing an example information 

obtaining procedure of the information obtaining unit 111. 

The information obtaining unit 111 first refers to the 

file list in the file list storing unit 121 and checks 

whether there is any as-yet-unobtained information (step 
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S1201) . If there is not, the information obtaining 
procedure is terminated. If there is, the file addresses 
(or URLs) of the as-yet-unobtained sets of information are 
fetched one at a time (step S1202) . 

The information obtaining unit 111 then requests a 
connection with an external database, based on the fetched 
address (step S1203) , and checks whether the connection has 
been successively established (step S1204) . If the 
connection is unsuccessful, the processing returns to step 
S1203 (step S1204) . 

If the connection has been successful, the information 
obtaining unit 111 reads the file names of the as-yet- 
unobtained information from the file list, obtains the 
corresponding files from the external database, and stores 
them in the internal buffer (step S1205) . The processing 
then returns to step S1201. 

Procedure of the Transmission Data G enerating Unit 112 

Fig. 14 is a flowchart showing an example procedure for 
generating transmission data by the transmission data 
generating unit 112. 

The transmission data generating unit 112 first refers 
to the buffer in the information obtaining unit 111 and 
checks whether any unprocessed HTML documents exist (step 
S1301) . If no such documents exist, the display image 
generating procedure is terminated. If there is such a 
document, the transmission data generating unit 112 
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establishes the transmission data storage areas in the 
transmission data holding unit 113, assigns an 
identification number to each transmission data storage 
area, and then fetches an unprocessed HTML document from the 
buffer (step S1302) , 

The transmission data generating unit 112 creates 
index information indicative of the file name of the 
transmission data from the file name of the fetched HTML 
dociiment, and adds the index information to the link 
information storage area established in the transmission 
data holding unit 113 (step S1303) . 

One character is read from the fetched HTML document 
and is written into the character string storage area (step 

51304) . 

The transmission data generating unit 112 then checks 
whether the read character is a tag start sign "<" (step 

51305) . If so, the processing advances to step S1307, or if 
not, the character is added to the character string storage 
area in the work area, and the processing returns to step 
S1304 (step S1306) . 

The next character is read (step S1307) , and the 
transmission data generating unit 112 judges whether the 
read character is a tag end sign ">" (step S1308) . If so, 
the processing advances to step S1310, or if not, the read 
character is added to the tag storage area in the working 
area, before the processing returns to step S1307 (step 
S1309) . 
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The character string in the tag storage area is 
compared with the tag table, and a check is performed to see 
whether it starts with a "/" sign (step S1310) • If it does, 
the transmission data generating unit 112 judges whether the 
5 read tag is a "</HTML>" tag (step S1311) . If so, the 

transmission data generating unit 112 resets the work area, 
and the processing returns to step S1310. If the read tag 
is not "</HTML>", the transmission data generating unit 112 
operates in accordance with the least significant of the 
10 flags set in the flag storage area corresponding to this 

read tag, and resets the corresponding storage area in the 
work area (step S1312), before the processing returns to 
step S1304. 

In step S1310, when the character string does not start 
15 with "/", a check is performed to see whether the read tag 
is "<IMG>" (step S1313) . If so, the transmission data 
generating unit 112 fetches the image information file 
specified by the attribute of the "<IMG>" tag from the 
buffer in the information obtaining unit 111 (step S1314) . 
20 The fetched image information is converted in accordance 
with a GIF decompression method into image information 
expressed as bitmap data (step S1315) , and the processing 
returns to step S1304. 

If the read tag is not "<IMG>", the character string in 
25 the tag storage area is compared with the content of the tag 
table and a flag corresponding to the tag is set in the flag 
storage area. The transmission data generating unit 112 




then operates in accordance with this tag (step S1316) , 
before the processing returns to step S1304. 

A variety of tags can be employed in the HTML 
documents, and the processes represented by these tags can 
5 be performed in the same way as a conventional browser. 

Accordingly, the following explanation focuses on an example 
of the processing in step S1312 for the tag "</A>" which 
relates to the link information which generated in a special 
format for this data communication system 100, 

10 Fig. 15 is a flowchart showing a detailed example of the 

processing in step S1312 of Fig. 14. 

The transmission data generating unit 112 first checks 
whether the read tag is "<A>" (step S1401) , and if not, the 
processing advances to step S1408. 

15 If the read tag is "<A>", the transmission data 

generating unit 112 judges whether the link destination file 
specified by the attribute is an audio information file 
(step S1402) . If it is, the processing advances to step 
S1407, or if not, the transmission data generating unit 112 

20 generates display image information for the character string 
established in the character string storage area, in doing 
so leaving a display area for displaying a cursor design, 
before adding the generated display image information to the 
display image information storage area provided in the 

25 transmission data holding unit 113 (step S1403) - 

The transmission data generating unit 112 then 
calculates the X-Y coordinates which express the display 




position of the cursor design (step S1404) . 

The transmission data generating unit 112 then 
generates hot spot information based on the calculated X-Y 
coordinates and the attribute established in the tag storage 
5 area, and adds it to the link information storage area 

provided in the transmission data holding unit 113 (step 
S1405) . 

The transmission data generating unit 112 then resets 
the link flag in the work area, and deletes the character 
10 string in the tag storage area and the character-sequence 
storage area (step S1406) . 

The transmission data generating unit 112 fetches an 
audio information file and converts the audio information 
contained in the file into information of a predetermined 
15 format which it stores in the audio information storage area 
(step S1407) . 

The transmission data generating unit 112 operates in 
accordance with the read tag (step S1408) , 

Structure of the Data Receiving Apparatus 150 
20 The following is an explanation of the components of 

the data receiving apparatus 150, with reference to Figs. 16 
to 20. 



Structure of the Separating Unit 151 

The separating unit 151 includes a read buffer 161 for 
25 reading the identification number allotted to transmission 
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data. The read buffer 151 has storage areas for temporarily 
holding the display image information (including audio 
information) included in one transmission file and the link 
information included in one transmission file. 
5 The separating unit 151 separates display image 

information (including audio information) and link 
information from the received transmission data, and stores 
the separated display image information and link information 
in the corresponding storage areas of the read buffer 161- 
10 The identification number assigned to the display image 
information stored in the storage area is read by 
recognizing the image written in the predetermined part of 
the non-displayed area of the display image information. 
The identification number assigned to the link information 
15 is read in the same manner as when reading an identification 
number assigned to a conventional digital data file. If the 
read identification number is the identification number 
designated by the control unit 155, the display image 
information (including audio information) • or the link 
20 information held by the read buffer 161 is stored in the 

corresponding storage area in the received data holding unit 
152, At this point, any audio* information which is present 
is stored by the separating unit 151 in a corresponding 
storage area provided in the received data holding unit 152 
25 at the same time as the display image information is stored, 
so that the audio information is gradually accumulated while 
the display image information with the identification niomber 



designated by the control unit 155 is repetitively 
transmitted. By doing so, audio information which is 
transmitted across a plurality of frames can be separated 
from the transmission data. 

If the read identification number is not the 
identification number designated by the control unit 155, 
the display image information (including audio information) 
or its link information held by the read buffer 161 is 
discarded. The reading of new display image information 
(including audio information) and link information is 
continued, and the above procedure is repeated until the 
identification number designated by the control unit 155 is 
detected. 

Structures of the Received Data Holding Unit 152. 

the Reproducing Unit 153, and the Display Unit 154 , 
The received data holding unit 152 stores display image 
information (including audio information) and link 
information separated by the separating unit 151 linked with 
their assigned identification number. The storage area for 
storing the display image information can be achieved by RAM 
or a hard disk device capable 'of storing one static image 
which is the size of the display screen. 

The reproducing unit 153 reproduces the display image 
information stored in the received image holding unit 152 
along with the graphics information (described later) 
inputted from the control unit 155, in accordance with an 
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indication which it receives from the control unit 155, The 
reproducing unit 153 outputs the reproduced image to the 
display unit 154. The reproducing unit 153 also reproduces 
the stored audio information in synchronization with the 
reproduction display image information and outputs the 
reproduced audio to the audio output unit 157. 

The display unit 154 can be realized by a television 
monitor which displays images according to NTSC (National 
Television System Committee) standard, and is used to 
display the display image and cursor design on its screen, 
in accordance with the input from the reproducing unit 153. 

Structure of the Control Unit 155 

The control unit 155 sets an initial value in the 
register storing a variable (described later) , and instructs 
the separating unit 151 to fetch the display image 
information (including audio information) and link 
information of a page specified by this initial value, which 
as one example can be the identification number "0001". 

The control unit 155 instructs the reproducing unit 153 
to reproduce the display image information (including audio 
information) , every time new display image information 
(including audio information) is stored in the received data 
holding unit 152. Every time new link information is stored 
in the received data holding unit 152, the control unit 155 
interprets the link information and generates a cursor 
design correspondence table in which cursor designs 
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(described later) are generated for each cursor display 
position. These cursor designs are expressed by cursor 
information which is held inside the control unit 155. The 
control unit 155 outputs design information expressing a 
5 cursor design together with the cursor position to the 

reproducing unit 153, as well as indicating the reproduction 
of the cursor design. 

Fig. 16 shows an example of the cursor design 
correspondence table which the control unit 155 generates to 

10 control the display position of the cursor design. 

The cursor design correspondence table shows the 
correspondence between each cursor display position which is 
expressed in the hot spot information in the link 
information stored in the received data holding unit 152 and 

15 the cursor number for the cursor design to be displayed at 
each cursor display position. The control unit 155 assigns 
cursor numbers to each cursor display position in the link 
information in order of lowest Y coordinate and then lowest 
X coordinate, as one example, and writes each display 

20 position into the item with corresponding cursor number in 
the cursor design correspondence table. 

Fig. 17 shows an example of the design information 
stored by the control unit 155. As shown in Fig. 17, the 
control unit 155 stores cursor information which expresses 

25 a cursor design for each cursor number when the number is 

selected (referred to as the "selection state") and a cursor 
design for each number when the number is not selected 




(referred to as the "non-selection state") . 

On receiving an interrupt from the signal receiving 
unit 156, the control unit 155 interprets the type of input 
signal stored in the signal receiving unit 156, selects the 

5 design information of the corresponding cursor design, and 
outputs the cursor information to the reproducing unit 153. 
Following this, the control unit 155 controls the handling 
of the received data by the separating unit 151, in 
accordance with the cursor whose selection has been 

10 confirmed. 

Display Control Procedure for the Received Data 

The following is a detailed explanation of the display 
control procedure by the control unit 155 for a set of 
received data, a set of received data referring to display 
15 image information (including audio information) and link 

information which have been stored in corresponding storage 
areas in the received data holding unit 152 by the 
separating unit 151 and which have the same identification 
number, 

20 The control unit 155 sets a predetermined value, such 

as "1", into the variable "P-lndex" which expresses the 
identification number of the received data to be displayed. 
The control unit 155 then sets a predetermined value, such 
as "1", into the variable "Cur-Pos" showing the cursor 

25 number which is in the selection state. Following this, the 
control unit 155 instructs the separating unit 151 to obtain 




the transmission data indicated by the variable "P-Index". 
The control unit 155 then interprets the link information in 
the received data which is received in accordance with this 
instruction and is stored in the received data holding unit 
5 152, and outputs the cursor information for each cursor, the 
cursor indicated by the variable Cur-Pos being in the 
selection state, together with the display position to the 
reproducing unit 153. Here, when an interrupt from the 
signal receiving unit 156 occurs, the control unit 155 
10 interprets the control signal stored in the signal receiving 
unit 156. First, the control unit 155 checks whether the 
input signal was "Up", in which case the control unit 155 
decreases the value of variable Cur-Pos by 1. If not, the 
control unit 155 checks whether the input signal was "Down", 
15 in which case the control unit 155 increases the value of 

variable Cur-Pos by 1 . If not, the control unit 155 checks 
whether the input signal was "Enter", in which case the 
control unit 155 finds the coordinates of the display 
position from the cursor number given by the variable Cur- 
20 pos, and obtains the identification number of the file which 
is the link destination file written in the hot spot 
information for these coordinates. The control unit 155 
then sets this identification number in the variable P- 
Index, and instructs the separating unit 151 to obtain the 
25 transmission data shown by the variable P-Index. 

Structure of the Signal Receiving Unit 156 
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and the Audio Output Unit 157 
On receiving an input signal from a remote controller 
(not-illustrated) or the like, the signal receiving unit 156 
creates an interrupt for the control unit 155 in accordance 
5 with the received input signal, as well as holding the 
received input signal. 

The audio output unit 157 can be realized by a speaker 
or the like, and is used to output the reproduced audio 
information as audio. 

10 Example of a Display Image 

Fig. 18 shows display image 1800 for the initial screen 
which is displayed by the display unit 154 based on the 
transmission data 800 shown in Figs.SA to 8C. 

As shown in Fig. 18, the display image 1800 has the 

15 cursor design 1801 corresponding to cursor number "1" 

displayed at a display position (100,600) indicated by the 
display image information 801, in accordance with the hot 
spot information given on line 812 of the link information 
803. It should be noted here that the cursor information 

20 which represents the selection state has been selected for 
cursor design 1801 in accordance with the initial value of 
the variable Cur-Pos which is held by the control unit 155. 

In the same way, the cursor design 1801 corresponding 
to cursor number "2" is displayed at a display position 

25 (100,700), in accordance with the hot spot information given 
on line 813 of the link information 803. It should be noted 




here that the cursor information which represents the non- 
selection state has been selected for cursor design 1802 
since its cursor number "2" does not coincide with the 
initial value of the variable Cur-Pos. 
5 Here, since the transmission data 800 includes audio. 

information 802 in addition to the display image information 
801, an audio commentary is outputted by the audio output 
unit 157 when the display image 1800 is displayed on the 
display unit 154. 
10 Fig. 19 shows the display image 1900 which is the 

initial screen displayed by the display unit 154 for the 
transmission data 900 shown in Figs . 9A and 9B. 

As with the display image 1800 in Fig. 18, the display 
image 1900 has the cursor design 1901 displayed at a display 
15 position (050,400) indicated by the display image 

information 901, in accordance with the hot spot information 
given on line 912 of the link information 902. Here, the 
cursor information for the selection state is selected as 
cursor design 1901. 
20 Fig. 20 shows the display image 2000 which is the 

initial screen displayed by the display unit 154 for the 
transmission data 1000 shown in Fig.lOA and lOB. 

As before, the display image 2000 has the cursor design 
2001, which corresponds to cursor number "1" and which shows 
25 the selection state, displayed at a display position 

(050,400) indicated by the display image information 1001, 
in accordance with the hot spot information given on line 




1012 of the link information 1002. 

Specific Example of the Procedure of the Control Unit 155 

The following is an explanation of a specific example 
of the procedure executed by the control unit 155 when 
5 displaying the display image 1800 on the display unit 154 
based on the transmission data 800. 

The control unit 155 first sets the initial value of 
the variable P-Index at "0001" and the initial value of the 
variable Cur-Pos at "1". Next^ the control unit 155 

10 instructs the separating unit 151 to obtain the display 

image information 801 (including the audio information 802) 
and the link information 803 which have the identification 
number "0001" set in the variable P-Index. The control unit 
155 then instructs the reproducing unit 153 to reproduce the 

15 display image information 801 (including audio information 
802) stored in the received data holding unit 152. The 
reproducing unit 153 reproduces the display image 
information 801 and outputs it to the display unit 154 and 
simultaneously reproduces the audio information 802 which it 

20 outputs to the audio output unit 157. The control unit 155 
interprets the link information 803 stored in the received 
data holding unit 152, generates a cursor design 
correspondence table ; and outputs design information for 
each cursor and their display positions to the reproducing 

25 unit 153. At this point, the cursor indicated by the 
variable Cur-Pos, which is to say the first cursor, is 
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displayed in the selection state. 

The control unit 155 then waits for an input from the 
signal receiving unit 156. Here, suppose that a "Down" 
signal is inputted into the signal receiving unit 156 from 
an external remote controller. When the input signal is 
"Down", the control unit 155 increases the value of variable 
Cur-Pos by "1", making it "2". Next, the cursor information 
for the selection state is selected as the design for cursor 
number "2" which is indicated by this updated variable Cur- 
Pos, and the cursor information for the non-selection state 
is selected as the design for cursor number "1" which was 
formerly indicated by the variable Cur-Pos, with these sets 
of cursor information being outputted to the reproducing 
unit 153. 

The control unit 155 waits for an interrupt from the 
signal receiving unit 15 6, with the following explanation 
describing the case when the signal receiving unit 156 
stores an input signal for a pressing of the "Enter" key 
after generating the interrupt. If the input signal is 
"Enter", the control unit 155 reads the X-Y coordinates 
(100,700) corresponding to cursor number "2" which is 
indicated by the variable Cur-Pos from the cursor design 
correspondence table. Next, the control unit 155 reads the 
identification number of the link destination file of the 
hot spot information on line 813, based on these X-Y 
coordinates (100,700), and obtains the identification number 
"0003", Next, this identification number "0003" is set as 
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the value of the variable P-Index. Following this, the 
control unit 155 instructs the separating unit 151 to obtain 
the display image information 1001 and the link information 
1002 which have the identification number indicated by this 
variable P-Index. The control unit 155 then resets the 
variable Cur-Pos to "1", 

By repeating the processing described above, the 
display image 2000 shown in Fig. 20 can be displayed on the 
display unit 154. Here, if an interrupt occurs when the 
value of the variable Cur-Pos is "1", and an input signal 
for "Enter" is being stored by the signal receiving unit 156 
when the control unit 155 refers to the signal receiving 
unit 156, the control unit 155 will have the display image 
1900 shown in Fig. 19 displayed on the display unit 154, as 
described above. 

Procedure for Display Control 

Fig. 21 is a flowchart showing an example procedure for 
display control which is performed by the control unit 155. 

The control unit 155 first sets the initial value of 
the variable P-Index which indicates the identification 
number of the transmission data to be obtained (step S2101) . 

The control unit 155 then sets the initial value of the 
variable Cur-Pos which indicates the cursor number of the 
cursor in the selection state for the start of display of 
each display screen (step S2102) . 

The control unit 155 then instructs the separating unit 

69 




151 to obtain the transmission data which has the 
identification number indicated by the variable P-Index. The 
separating unit 151 then separates the display image 
information and link information in accordance with the 
5 indication from the control unit 155, and stores the display 
image information and link information with their 
identification number in the received data holding unit 152 
(step S2103) . 

On being instructed by the control unit 155, the 

10 reproducing unit 153 reproduces the display image 

information in the received data holding unit 152 and 
outputs it to the display unit 154. When there is audio 
information which is related to the display image 
information, the reproducing unit 153 reproduces this audio 

15 information and outputs it to the audio output unit 157 
(S2104) . 

The control unit 155 interprets the link information in 
the received data holding unit 152 and outputs the design 
information for the cursor designs together with the X-Y 

20 coordinates for the display positions of the cursors, as 

well as an instruction to display the design information to 
the reproducing unit 153. The reproducing unit 153 
reproduces the design information inputted from the control 
unit 155 and outputs it to the display unit 154 (step 

25 S2105) . By doing so, one display image is displayed by the 
display unit 154. 

The control unit 155 waits for an interrupt from the 
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signal receiving unit 156 (step S2106) , and on receiving an 
interrupt, checks whether the input signal held by the 
signal receiving unit 156 is "Up" (step S2107) . 

If the input signal is "Up", the control unit 155 
5 subtracts "1" from the value of the variable Cur-Pos (step 
S2108) . If not, the control unit 155 checks whether the 
input signal held by the signal receiving unit 156 is "Down" 
(step S2109) . 

If the input signal is "Down", the control unit adds 
10 "1" to the value of the variable Cur-Pos (step S2110) . If 
not, the control unit 155 checks whether the input signal 
held by the signal receiving unit 155 is "Enter" (step 
S2111) . 

If the input signal in "Enter", the control unit 155 
15 uses the cursor number shown by the variable Cur-Pos to 
reference the cursor design correspondence table and so 
finds the cursor display position (X,Y) which it then uses 
to find the value of the identification number of the link 
destination file in the hot spot information. The control 
20 unit 155 then sets this identification number as the value 

of the variable P-Index. After this, the processing returns 
to S2102. 

If the input signal is not "Enter", the processing 
returns to S2106. 
25 As described above, in the present embodiment the 

display image information, which conventionally would have 
had to have been generated by the data receiving apparatus 




150 while the data receiving apparatus 150 is interpreting 
the control information, is generated and transmitted by the 
data transmitting apparatus 110, which reduces the load of 
each data receiving apparatus 150* Also, when compared with 
5 the large number and variety of display control processes 
for display character strings which were conventionally 
written into the control information, the link information 
of the present embodiment contains a smaller number and less 
variety of control processes. As a result, simulated 

10 bidirectional communication can be easily achieved by the 

data receiving apparatuses 150 using this link information. 

The present embodiment describes the case when in order 
to display WWW home pages on the Internet, the data 
communication system 100 uses a one-to-many TV broadcast to 

15 perform simulated bidirectional communication, so that when 
compared to the case when home pages are displayed by a 
browser on a personal computer, the display of the user's 
desired pages on the display unit 154 can be performed at a 
high speed which is unaffected by congestion. Since display 

20 image information is sent in a conventional TV format, the 
display of full color, high-resolution images can easily be 
achieved by the display unit 154. Also, while the display 
of display images generated by a browser for display on a TV 
monitor does not make full use of the components, such as 

25 the reproduction processing for display images, 

conventionally provided inside a TV, the present embodiment 
can achieve simulated bidirectional communication which 
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makes full use of circuitry, such as memory and decoders, 
conventionally provided inside a TV set. 

In the present embodiment, while the information to be 
obtained has been described as HTML documents which are used 
5 on the WWW together with compressed image information in GIF 
format and audio information in AU format, information 
expressed in other formats or languages, such as HyperCards, 
can be used. In such case, the processing for "<A>" tags 
refer to a method for conversion for the corresponding 
10 format and language. The present embodiment also describes 
the conversion of an HTML document containing only a limited 
number of tags, although other HTML tags may also be 
included. 

The present embodiment also describes an example where 
15 the control for simulated bidirectional communication 

performed according to the link information is the switching 
of the display to another display image, although other 
processes, such as a process for flashing display on the 
screen, a process for scrolling the display image, or a 
20 process for activating a device such as a fax, telephone, or 
video recorder connected to the data receiving apparatus, 
may be performed in addition fo simulated bidirectional 
communication . 

The data communication system 100 is also described as 
25 having identification numbers of files written into the link 
information by the transmission data generating unit 112, 
although this process need not to be performed. As one 
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alternative, the original file name may be written into the 
link information as the file identification number. When 
doing so, the file name can be attached to the display image 
information (including audio information) and link 
5 information in each set of transmission data during 

transmission, with the data receiving apparatus 150 which 
receives this information successively obtaining a complete 
set of link information after being switched on, so that it 
can then investigate the correspondence between file names 

10 and identification numbers. 

The data receiving apparatus 150 may also store a 
complete set of display image information and link 
information which are repeatedly transmitted by the data 
transmitting apparatus 110 in the received data holding unit 

15 152. 

When the transport stream shown in Fig.llB is 
transmitted from the data transmitting apparatus 110, the 
receiving apparatus 150 may first have the separating unit 
151 separate and obtain the PMT, before reading the PMT to 

20 find the PID of the display image information to be obtained 
and having the display image information separated and 
obtained from the transport stream with the read PID as a 
filter condition. It may also read the PID of the private 
stream including the link information from the PMT, and then 

25 separate and obtain the link information from the transport 
stream with the PID and the identification number (table ID 
extension) as the filter conditions. 
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The transport stream shown in Fig.llB was also 
described as having a video elementary stream made up of I 
pictures, although the video elementary stream may include B 
pictures and P Pictures, The display image information was 
5 also described as being encoded according to MPEG2 standard, 
although it may alternatively be encoded under another 
standard, such as MPEGl, JPEG, or GIF, Finally, the display 
image information and audio information were described as 
being transmitted as a video elementary stream and an audio 
10 elementary stream, although they may be multiplexed as 

private sections in the same way as the link information. 



Second Embodiment 

Fig. 22 is a block diagram showing the construction of 
the data communication system 2200 of the second embodiment 
15 of the present invention. It should be noted here that 

components which are the same as the first embodiment have 
been given the same reference numerals and will not be 
explained. 

The data communication system 2200 includes a data 
20 transmitting apparatus 2210 and a data receiving apparatus 
2250. 

The data transmitting apparatus 2210 is equipped with a 
transmission data generating unit 2211, in place of the 
transmission data generating unit 112 of the data 
25 transmitting unit 110, 

Each data receiving unit 2250 is equipped with a 
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control unit 2251 in place of the control unit 155. This 
control unit 2251 includes a design information storing unit 
2252. 

Data Transmitting Apparatus 2210 

The transmission data generating unit 2211 is equipped 
with a data conversion table storing unit 2212 in place of 
the data conversion table storing unit 122, although, with 
the exception of the link information table, the stored 
content of the data conversion table storing unit 2212 is 
the same as the data conversion table storing unit 122. 

Fig. 23 shows an example of the link information table 
2300 which is the stored content of the data conversion 
table storing unit 2212. 

In addition to the index information 701 and the hot 
spot information 702, the link information table 2300 also 
shows the format of the title information 2301. 

The title information 2301 is composed of an 
information identification part "TITLE" identifying the 
present information as title information, X-Y coordinates 
"X=999, Y-999" showing the title display position in the 
display screen in which the corresponding display image 
information is to be displayed, and a number of pixels 
"L=999" which expresses the length of the title character 
string on the display screen. Here, the title character 
string length is expressed as a number of pixels, although 
it may alternatively be expressed as a number of characters. 
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The transmission data generating unit 2211 generates 
title information indicating the composition of the title 
, supplementary design in accordance with the link information 
table in the data conversion table storing unit 2212, in 
5 addition to the processes performed by the transmission data 
generating unit 112. 

The following is a detailed description of the 
generation process for title information performed by the 
transmission data generating unit 2211, using the HTML 
0 document 301 shown in Fig. 3. Note that the initial display 
position which is set for each page in a WWW home page is 
(20,20) . 

After generating the index information from the file 
name of the HTML document 301, the transmission data 

5 generating unit 2211 interprets the tag "<HTML>" on line 311 
and identifies that this is the first line of the HTML 
document 301. Following this, it deletes the character 
string "HTML" in the tag storage area. 

Next, the transmission data generating unit 2211 reads 

0 the tag "<H1>" on line 312, looks up the tag "<H1>" in the 
tag table, and sets the headline flag in the flag storage 
area of the work area. 

Since the headline flag is set in the flag storage 
area, the transmission data generating unit 2211 generates 

5 title information and, in the same way as the transmission 
data generating unit 112, converts the character string 
"WEATHER REPORT" between the tag "<H1>" and "</Hl>" into 

77 



• 



image information using the HI headline font to generate 
display image information. 

More specifically, the transmission data generating 
unit 2211 refers to the link information table 2300 and 
5 finds the format of title information 2301. In the present 
case, this format is "<TITLE X=999, Y=999, L=999>", of which 
"X=999, Y-999" are the X-Y coordinates of the display 
position of the title. The display position of the title 
"WEATHER REPORT" which is given between the "<H1>" tags in 

10 the HTML document 301 is the coordinate position (20,20). 
Here, "L=999" shows the length of this character string. 
Since this character string is fourteen characters long, if 
the dimensions of each character in the HI headline font are 
(10,10), the length L of this character string will be 

15 "140". As a result, the transmission data generating unit 
2211 will generate the title information "<TITLE X=020, 
Y==020, L=140>" and add it to the link information storage 
area of the transmission data holding unit 113. The 
processes performed after this are the same as the 

20 transmission data generating unit 112, and so will not be 
explained. 

Figs.24A, 24B, and 24C show the transmission data 2400 
for the first page of the WWW home page which is generated 
from the HTML document 301, the audio information 
25 "Weather.au", and the image information 401. This 
transmission data 2400 is composed of display image 
information 801, the audio information 802, and the link 
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information 2401. The content of Figs. 24A and 24B is the 
same as Figs. 8A and 8B, while Fig.24C shows the content of 
the link information 2401 which differs from Fig. 8C. 

As shown in Fig.24C, the link information 2401 includes 
5 title information which is written on line 2412 after the 
index information on line 2411. Following this, the hot 
spot information is written on lines 2413 and 2414. This 
hot spot information is the same as the hot spot information 
on lines 812 and 813 of the link information 803 given in 
10 Fig. 8C. 

Fig. 25 is a flowchart for an example of the procedure 
of the transmission data generating unit 2411 for an "<H1>" 
tag. 

In step S1408 shown in Fig. 15, the transmission data 
15 generating unit 2211 checks whether the tag is an "<H1>" tag 
(step S2501) , and if not, the processing advances to step 
S2512. 

If the tag is an "<H1>" tag, the transmission data 
generating unit 2211 sets the headline flag, calculates the 
20 coordinates of the title display position, and stores the 
calculated value in the appropriate registers as the title 
display position and as the next character display position 
(step S2502) . 

The transmission data generating unit 2211 then checks 
25 whether a character string is being stored in the character 
string storage area (S2503) and if not, the processing 
advances to step S2509. If a character string is being 



stored in the character string storage area, the 
transmission data generating unit 2211 reads one character 
from the character string storage area and deletes the 
character from the character string storage area (step 

5 S2504) . The transmission data generating unit 2211 then 

converts the character into an image using the Hi headline 
font (step S2505) . Following this, the transmission data 
generating unit 2211 arranges the character image at the 
next character display position and generates display image 

10 information (step S2506) . After adding the generated 

display image information to the display image information 
storage area (step S2507) , the next character display 
position is updated in accordance with the character size of 
the HI headline font (step S2508), before the processing 

15 returns to step S2503. 

Since all of the character strings in the character 
string storage area have been converted into images, the 
transmission data generating unit 2211 calculates the title 
character string length by subtracting the coordinate value 

20 of the title display position from the coordinate position 
of the next character display position (step S2509) . Next, 
the transmission data generating unit 2211 generates the 
title information from the title character string length and 
the coordinates of the title display position, in accordance 

25 with the format of the title information 2301 of the link 

information table 2300 (step S2510) , and adds the generated 
title information to the link information storage area (step 




52511) . It then processes the other tags as before (step 

52512) . 

Data Receiving Apparatus 2250 

In addition to the processes of the control unit 155, 
5 the control unit 2251 outputs the title supplementary design 
stored in the design information storing unit 2252 to the 
reproducing unit 153 together with the X-Y coordinates 
showing the display position and the title character string 
length, in accordance with the title information in the link 

10 information. When doing so, the control unit 2251 instructs 
the reproducing unit 153 to reproduce the title 
supplementary design in the current display screen. As one 
example, the control unit 2251 may read and store the X-Y 
coordinates showing the display position for the title 

15 supplementary design and the title character string length 
from the title information every time new link information 
is stored in the received data holding unit 152. 
Additionally, after instructing the reproducing unit 153 to 
reproduce the display image information, the control unit 

20 2251 reads the title supplementary design from the design 
information storing unit 2252 and outputs the read 
information together with the display position (X-Y 
coordinates) for the title supplementary design and the 
title character string length to the reproducing unit 153. 

25 The control unit 2251 then indicates that the length of the 
title supplementary design should be set in accordance with 

81 




the title character string length and that the title 
supplementary design should be combined with the display 
image for the display image information at the appropriate 
X-Y coordinates. This processing is performed between step 
5 S2104 and step S2105 in Fig. 21. 

The design information storing unit 2252 stores title 
supplementary designs, in addition to the cursor designs. 

Fig. 26 shows an example of the stored content of the 
design information storing unit 2252. 
10 The design information storing unit 2252 stores cursor 

designs 2601 for the non-selection state, cursor designs 
2602 for the selection state, and title supplementary 
designs 2603 . 

The cursor designs 2 601 are read by the control unit 
15 2251 after referring to the cursor design correspondence 

table, and are displayed at the display positions which are 
not indicated by the cursor number given in the variable 
Cur-Pos . 

One of the cursor designs 2602 is also read by the 
20 control unit 2251, having referred to the cursor design 
correspondence table, and is displayed at the display 
position which is indicated by 'the cursor number given in 
the variable Cur-Pos. 

As shown in Fig. 26, the title supplementary design 
25 2 603 is stored with its height having been set beforehand to 
correspond to the size of the HI headline font, so that by 
adjusting their length in accordance with the title 




character string length and displaying the design 2 603 
superimposed at the display position of the character images 
of the HI headline font, the text image displayed using the 
HI headline font will be surrounded by a dotted line. This 
5 title supplementary design 2 603 is read in accordance with 
the information identification part "TITLE" in the title 
information. 

Fig. 27 shows the display screen 2700 for the first 
screen which is displayed in accordance with the 

10 transmission data 2400 shown in Figs. 24A, 24B, and 24C. 

As shown in Fig, 27, a text image for "WEATHER REPORT" 
which is the title and which has a title character string 
length of "140" is displayed at the title display position 
(20,20) in the display screen 2700. This text image is 

15 displayed surrounded by the title supplementary design 2701 
stored in the design information storing unit 2252. 

The cursor design 2702 for "H0TSP0T2" is displayed at 
the display position shown by the display position for the 
cursor number shown in initial set value of the variable 

20 Cur-Pos. The cursor design 2703 for "HOTSPOTl" is displayed 
at the other cursor display position. 

In addition to the effect of the data communication 
system 100 of the first embodiment, the data communication 
system 2200 of the present embodiment enables the data 

25 receiving apparatus 2250 to display a unique title 

supplementary design on its display screen without a 
significant increase in the load of the data receiving 




apparatus 2250, 

There is a further benefit in that with the present 
embodiment, the data communication apparatus 2200 indicates 
the display positions of the cursor designs in the hot spot 
5 information, with the data receiving apparatus 2250 

displaying cursor designs which it stores beforehand, so 
that the control for the display of cursor designs is 
perfoimed at the receiver's end. As a result, the data 
transmitting apparatus 2210 no longer needs to transmit the 

10 same content of display image information just to express a 
change in the selection state or non-selection state of 
cursor designs, thereby improving the efficiency of 
information transfer for the display image information. 

By storing design information for different designs in 

15 different models of data receiving apparatuses 2250, for 

example, it becomes possible to customize the cursor designs 
for each model of data receiving apparatus 2250. These 
customized designs can then be displayed to draw the user's 
attention to important display items on the screen. Since a 

20 plurality of sets of design information can be stored in the 
data receiving apparatus, the user may select a desired set 
of cursors and have them displayed. 

It should be noted that the cursor design and the title 
supplementary design shown in Fig. 2 6 may be expressed as 

25 bitmap data which is a grouping of pixels, or as vector 

graphics data which is composed of coordinate data showing 
the display positions of the lines which fundamentally 




compose the design. 

Third Embodiment 

Fig. 28 is a block diagram showing the construction of 
the data communication system 3200 of the third embodiment 
5 of the present invention. It should be noted that 

components which are the same as the data communication 
system 2200 shown in Fig. 22 have been given the same 
reference numerals and will not be explained. 

The data communication system 3200 is composed of a 
10 data transmitting apparatus 3210 and a data receiving 
apparatus 3250 . 

The data transmitting apparatus 3210 is equipped with a 
supplementary design adding unit 3211, in addition to the 
construction of the data transmitting apparatus 2210. 
15 The data receiving apparatus 3250 is equipped with a 

supplementary design obtaining unit 3253, in addition to the 
construction of the data receiving apparatus 2250. 

The design information stored in Fig. 2 6 is stored in 
an external database. 

20 Supplementary Design Adding Unit 3211 

The supplementary design adding unit 3211 reads the 
design information shown in Fig. 2 5 from an external 
database, and adds the read design information to the link 
information stored in the transmitted data holding unit 113. 

25 Figs. 29A to 29C show the transmission data 3400 which 
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includes the link information 3401 to which the design 
information shown in Fig. 26 has been added. This 
transmission data 3400 is composed of display image 
information 801, audio information 802, and link information 
5 3401. Figs. 29A and 29B correspond to Figs, 24A and 24B. 
Fig. 29C, meanwhile, shows the content of the link 
information 3401. 

As shown in Fig. 29C, index information is written on 
line 3411 of link information 3401, title information is 
10 written on line 3412, and hot spot information is written on 
lines 3413 and 3414. Following this, design information 3415 
is given. 

Supplementary design obtaining unit 3253 

The supplementary design obtaining unit 3253 obtains 

15 only the design information from the link information stored 
in the received data holding unit 152 and stores it in the 
design information storing unit 2252 provided in the control 
unit 2251. Following this, the supplementary design 
obtaining unit 3253 deletes the design information from the 

20 link information stored in the transmitted data holding unit 
152. 

In addition to the effects of the data communication 
system 2200, the data communication system 3200 of the 
present embodiment has the data transmitting apparatus 3210 
25 transmit design information obtained from an external 

database to the data receiving apparatus 3250, so that the 




supplementary designs stored by the data receiving apparatus 
can be updated using a variety of different designs. 

Although the present invention has been fully described 
by way of examples with reference to accompanying drawings, 
5 it is to be noted that various changes and modifications 
will be apparent to those skilled in the art. Therefore, 
unless such changes and modifications depart from the scope 
of the present invention, they should be construed as being 
included therein. 
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WHAT IS CLAIMED IS: 

1 1. A transmitting apparatus for an interactive communication 

2 system using a broadcast wave, comprising: 

3 first storage means for storing a plurality of frames 

4 of image data; 

5 second storage means for storing control information 

. 6 which shows links between said plurality of frames of image 

7 data stored in said first storage means, and which indicates 

8 a combining of a supplementary design with the image data 

9 stored in the first storage means, the supplementary design 

10 being stored by a receiving apparatus and being combined 

11 with an image represented by the image data; and 

12 transmitting means for repeatedly transmitting a 

13 predetermined number of frames of image data together with 

14 corresponding control information. 

1 2. A transmitting apparatus according to Claim 1, wherein 

2 said transmitting means includes: 

3 reading means for repeatedly reading said predetermined 

4 number of frames of image data together with said 

5 corresponding control information from said first and second 

6 storage means; 

7 multiplexing means for multiplexing image data and 

8 control information read by said reading means by 

9 transmitting said image data and control information in 

10 image sections and vertical blanking intervals, 

11 respectively, of a television signal; and 
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12 output means for outputting the multiplexed television 

13 signal as an analog broadcast wave* 

1 3. A transmitting apparatus according to Claim 1, wherein 

2 said image data and control information stored in said first 

3 and second storage means are digitized, 

4 and wherein said transmitting means includes: 

5 reading means for repeatedly reading said predetermined 

6 number of frames of image data together with said 

7 corresponding control information from said first and second 

8 storage means; 

9 multiplexing means for converting image data and 

10 control information read by said reading means into digital 

11 data streams, and multiplexing said digital data streams to 

12 produce a multiplexed stream; and 

13 output means for outputting said multiplexed stream as 

14 a digital broadcast wave. 

1 4 . A transmitting apparatus for an interactive communication 

2 system using a broadcast wave, comprising: 

3 first storage means for storing a plurality of frames 

4 of image data with an identifier allocated to each frame of 

5 image data; 

6 second storage means for storing control information 

7 for each frame of image data showing a link to another frame 

8 of image data stored in said first image storage means, the 

9 same identifier being allocated to corresponding image data 
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10 and control information, and said control information also 

11 indicating a combining of a supplementary design with the 

12 image data stored in the first storage means, the 

13 supplementary design is being stored by a receiving 

14 apparatus and being combined with an image represented by 

15 the image data; and 

16 transmitting means for repeatedly transmitting a 

17 predetermined number of frames of image data together with 

18 corresponding control information. 

1 5. A transmitting apparatus according to Claim 4, wherein 

2 said control information includes identifiers allocated to 

3 linked image data. 

1 6. A transmitting apparatus according to Claim 5, wherein 

2 said transmitting means includes: 

3 reading means for repeatedly reading all combinations 

4 of image data and control information from said first and 

5 second storage means, each combination including image data 

6 and control information with the same identifier; 

7 multiplexing means for multiplexing image data and 

8 control information read by said reading means by 

9 transmitting said image data and control information in 

10 image sections and vertical blanking intervals, 

11 respectively, of a television signal; and 

12 output means for outputting the multiplexed television 

13 signal as an analog broadcast wave. 
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7. A transmitting apparatus according to Claim 6, wherein 
said multiplexing means allocates an image representing an 
identifier arranged at a fixed position in a non-displayed 
part of an image section. 

8. A transmitting apparatus according to Claim 5;r wherein 
said transmitting means includes: 

reading means for repeatedly reading all combinations 
of image data and control information from said first and 
second storage means, each combination including one frame 
of image data and corresponding control information with the 
same identifier; 

multiplexing means for converting image data and 
control information read by said reading means into digital 
data streams, and multiplexing said digital data streams so 
as to produce a multiplexed stream; and 

output means for outputting said multiplexed stream as 
a digital broadcast wave. 

9. A transmitting apparatus according to Claim 8, wherein 
said multiplexing means includes: 

a converter for converting image data into a first 
digital data stream and control information into a second 
digital data stream; 

an ID allocating unit for allocating first identifying 
information to said first digital data stream for 
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8 identifying image data and second identifying information to 

9 said second data stream for identifying control information; 

10 a table producing unit for producing a mapping table 

11 showing the correspondence between said first identifying 

12 information and image data identifiers and the 

13 correspondence between said second identifying information 

14 and control information identifiers; and 

15 a multiplexing unit for multiplexing said first digital 

16 data stream, said second digital data stream, and said 

17 mapping table. 

1 10. A transmitting apparatus according to Claim 5, further 

2 comprising third storage means for storing audio data 

3 corresponding to said image data, the same identifiers being 

4 allocated to corresponding image data and audio data, 

5 wherein said transmitting means transmits audio data as 

6 well as image data. 

1 11. A transmitting apparatus according to Claim 10, wherein 

2 said transmitting means includes: 

3 reading means for repeatedly reading all combinations 

4 of image data, control information, and audio data from said 

5 first, second, and third storage means, each combination 

6 including image data, control information, and audio data 

7 with the same identifier; 

8 multiplexing means for multiplexing a combination of 

9 image data, audio data, and control information read by said 
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10 reading means to produce a television signal, said audio 

11 data being transmitted on a television audio signal, a 

12 plurality of frames of image data and control information 

13 being transmitted in the image section and vertical blanking 

14 interval, respectively, of a television image signal, and 

15 the number of transmitted frames of image data and control 

16 information depending on the reproducing time of the audio 

17 data; and 

1^ output means for outputting the multiplexed television 

19 signal as an analog broadcast wave. 

1 12. A transmitting apparatus according to Claim 11, wherein 

2 said multiplexing means allocates an image representing 

3 an identifier in a fixed position in a non-displayed part of 

4 said image section. 

1 13. A transmitting apparatus according to Claim 10, wherein 

2 said transmitting means comprises: 

3 reading means for repeatedly reading all combinations 

4 of image data, control information, and audio data from said 

5 first, second, and third storage means, each combination 

6 including one frame of image data, control information, and 

7 audio data with the same identifier; 

8 multiplexing means for converting image data, audio 

9 data, and control information read by said reading means 

10 into digital data streams, and multiplying said digital data 

11 streams to produce a multiplexed stream; and 
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12 output means for outputting said multiplexed stream as 

13 a digital broadcast wave. 

1 14. A transmitting apparatus according to Claim 13, wherein 

2 said multiplexing means comprises: 

3 a converter for converting image data into a first 

4 digital data stream, control information into a second data 

5 stream, and audio data into a third digital data stream; 

s an ID allocating unit for allocating said first digital 

7 data stream first identifying information to identify image 

8 data, said second digital data stream second identifying 

9 information to identify control information, and said third 

10 digital data stream third identifying information to 

11 identify audio data; 

12 a table producing unit for producing a mapping table 

13 showing the correspondence between said first identifying 

14 information and image data identifiers, the correspondence 

15 between said second identifying information and control 

16 information identifiers, and the correspondence between said 

17 third identifying information and audio data identifiers; 

18 and 

19 a multiplexing unit for rrtultiplexing said first, 

20 second, and third digital data streams, and said mapping 

21 table. 

1 15. A transmitting apparatus for an interactive 

2 communication system using a broadcast wave, comprising: 
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3 obtaining means for obtaining pieces of page 

4 information representing a page containing characters and 

5 images, said page information including link information to 

6 show a link to another page, character information, and 

7 image information; 

8 first producing means for producing one frame of image 

9 data containing characters and images in accordance with 

10 said character information and image information included in 

11 a piece of page information; 

12 second producing means for interpreting said link 

13 information included in said obtained page information and 

14 producing, for each frame of image data, control information 

15 including image link information about a link to another 

16 frame of image data and supplementary design combining 

17 information indicating a combining of a supplementary design 

18 with the frame of image data generated by the first 

19 producing means, the supplementary design being stored by a 

20 receiving apparatus and being combined with an image 

21 represented by the image data; 

22 first storage means for storing a predetermined number 

23 of frames of image data produced by said first producing 

24 means; 

25 second storage means for storing said control 

26 information produced by said second producing means; and 

27 transmitting means for repeatedly transmitting said 

28 predetermined number of frames of image data together with 

29 said control information. 
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1 16. A transmitting apparatus according to Claim 15, wherein 

2 said obtaining means obtains said page information from 

3 the World Wide Web on the Internet. 

1 17. A transmitting apparatus according to Claim 15, wherein 

2 the second producing means includes: 

3 determining means for determining a specific image part 

4 by interpreting layout information in said obtained page 

5 information; and 

6 generating means for generating supplementary design 

7 combining information indicating a supplementary design 

8 which is related to the determined specific image part, 

9 wherein the page information also includes layout 
10 information showing a layout of characters and images. 

1 18. A transmitting apparatus according to Claim 17, wherein 

2 the determining means determines a headline as the specified 

3 image part, and the generating means generates supplementary 

4 design combining information which indicates a combining of 

5 the specific image part with a supplementary design for bold 

6 display. 

1 19. A transmitting apparatus according to Claim 18, wherein 

2 the supplementary design combining information includes a 

3 classification of the specific image part. 
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1 20. A transmitting apparatus according to Claim 18, wherein 

2 the supplementary design combining information includes 

3 coordinates indicating the specific image part, 

1 21. A transmitting apparatus according to Claim 18, wherein 

2 the second producing means includes: 

3 supplementary design storage means for storing a 

4 supplementary design beforehand; and 

5 supplementary design adding means for reading a 

6 supplementary design from the supplementary design storage 

7 means and for adding the read supplementary design to the 

8 stored control information. 

1 22. A transmitting apparatus according to Claim 21, wherein 

2 the second producing means further includes supplementary 

3 design obtaining means for obtaining a supplementary design 

4 from outside and storing the obtained supplementary design 

5 in the supplementary design storage means. 

1 23. A transmitting apparatus according to Claim 17, wherein 

2 the determining means determines one of a character and an 

3 image to which a link has been attached as the specific 

4 image part, and the generating means generates supplementary 

5 design combining information indicating a combining of 

6 supplementary design, which shows that a link to another 

7 frame of image data is attached, with the specified image 

8 part. 
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1 24. A transmitting apparatus according to Claim 23, wherein 

2 the determining means determines one of a character and an 

3 image to which a link has been attached as the specific 

4 image part, and the generating means generates supplementary 

5 design combining information indicating a combining of 

6 supplementary design, which shows that a link to another 

7 frame of image data is attached, with the specified image 

8 part. 

1 25. A transmitting apparatus according to Claim 23, wherein 

2 the supplementary design combining information includes 

3 coordinates indicating the specific image part. 

1 27. A transmitting apparatus according to Claim 2 6, wherein 

2 the second producing means further includes supplementary 

3 design obtaining means for obtaining a supplementary design 

4 from outside and storing the obtained supplementary design 

5 in the supplementary design storage means. 

1 28. A transmitting apparatus according to Claim 17, wherein 

2 the second producing means includes: 

3 supplementary design storage means for storing a 

4 supplementary design beforehand; and 

5 supplementary design adding means for reading a 

6 supplementary design from the supplementary design storage 

7 means and for adding the read supplementary design to the 
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8 Stored control information. 

1 29. A transmitting apparatus according to Claim 28, wherein 

2 the second producing means further includes supplementary 

3 design obtaining means for obtaining a supplementary design 

4 from outside and storing the obtained supplementary design 

5 in the supplementary design storage means. 

1 30. A transmitting apparatus according to Claim 29, wherein 

2 the determining means determines a headline as the specified 

3 image part, and the generating means generates supplementary 

4 design combining information which indicates a combining of 

5 the specific image part with a supplementary design for bold 

6 display. 

1 31. A transmitting apparatus according to Claim 30, wherein 

2 the supplementary design combining information includes a 

3 classification of the specific image part. 

1 32. A transmitting apparatus according to Claim 30, wherein 

2 the supplementary design combining information includes 

3 coordinates indicating the specific image part. 

1 34. A transmitting apparatus according to Claim 33, wherein 

2 the supplementary design combining information includes a 

3 classification of the specific image part. 
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1 35. A transmitting apparatus according to Claim 33, wherein 

2 the supplementary design combining information includes 

3 coordinates indicating the specific image part. 

1 3 6. A transmitting apparatus according to Claim 15, wherein 

2 the second producing means includes: 

3 determining means for interpreting layout information 

4 in said, obtained page information and determining a specific 

5 image part; and 

6 generating means for generating supplementary design 

7 combining information indicating a supplementary design 

8 which is related to the determined specific image part, 

9 wherein the page information also includes layout 
10 information showing a layout of characters and images. 

1 37. A transmitting apparatus according to Claim 36, wherein 

2 the determining means determines the specified image part as 

3 a headline, and the generating means generates supplementary 

4 design combining information which indicates a combining of 

5 the specific image part with a supplementary design for bold 

6 display. 

1 38. A transmitting apparatus according to Claim 37, wherein 

2 the supplementary design combining information includes a 

3 classification of the specific image part. 

1 39. A transmitting apparatus according to Claim 37, wherein 
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2 the supplementary design combining information includes 

3 coordinates for determining the specific image part. 

a 40. A transmitting apparatus according to Claim 37, wherein 

2 the second producing means includes: 

3 supplementary design storage means for storing a 

4 supplementary design beforehand; and 

5 supplementary design adding means for reading a 

6 supplementary design from the supplementary design storage 

7 means and for adding the read supplementary design to the 

8 stored control information. 

1 41. A transmitting apparatus according to Claim 40, wherein 

2 the second producing means further includes supplementary 

3 design obtaining means for obtaining a supplementary design 

4 from outside and storing the obtained supplementary design 

5 in the supplementary design storage means. 

1 42. A transmitting apparatus according to Claim 36, wherein 

2 the determining means determines one of a character and an 

3 image to which a link has been attached as the specific 

4 image part, and the generating 'means generates supplementary 

5 design combining information indicating a combining of 

6 supplementary design, which shows that a link to another 

7 frame of image data is attached, to the specified image 

8 part. 
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1 44. A transmitting apparatus according to Claim 42, wherein 

2 the supplementary design combining information includes 

3 coordinates indicating the specific image part. 

1 45. A transmitting apparatus according to Claim 42, wherein 

2 the second producing means includes: 

3 supplementary design storage means for storing a 

4 supplementary design beforehand; and 

5 supplementary design adding means for reading a 

6 supplementary design from the supplementary design storage 

7 means and for adding the read supplementary design to the 

8 stored control information. 

1 4 6. A transmitting apparatus according to Claim 45, wherein 

2 the second producing means further includes supplementary 

3 design obtaining means for obtaining a supplementary design 

4 from outside and storing the obtained supplementary design 

5 in the supplementary design storage means . 

1 47. A transmitting apparatus according to Claim 36, wherein 

2 the second producing means includes: 

3 supplementary design storage means for storing a 

4 supplementary design beforehand; and 

5 supplementary design adding means for reading a 

6 supplementary design from the supplementary design storage 

7 means and for adding the read supplementary design to the 

8 stored control information. 
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1 48. A transmitting apparatus according to Claim 47, wherein 

2 the second producing means further includes supplementary 

3 design obtaining means for obtaining a supplementary design 

4 from outside and storing the obtained supplementary design 

5 in the supplementary design storage means. 

1 50. A transmitting apparatus according to Claim 49, wherein 

2 the supplementary design combining information includes a 

3 classification of the specific image part. 

1 52, A transmitting apparatus according to Claim 48, wherein 

2 the determining means determines one of a character and an 

3 image to which a link has been attached as the specific 

4 image part, and the generating means generates supplementary 

5 design combining information indicating a combining of 

6 supplementary design, which shows that a link to another 

7 frame of image data is attached, with the specified image 

8 part. 

1 53. A transmitting apparatus according to Claim 52, wherein 

2 the determining means determines one of a character and an 

3 image to which a link has been attached as the specific 

4 image part, and the generating means generates supplementary 

5 design combining information indicating a combining of 

6 supplementary design, which shows that a link to another 

7 frame of image data is attached, with the specified image 
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8 part. 

1 55. A transmitting apparatus according to Claim 15, wherein 

2 said first producing means allocates identifiers to image 

3 data, 

4 said second producing means allocates said identifiers 

5 to control information corresponding to said image data, 

6 said first and second storage means store said image 

7 data and control information together with said identifiers, 

8 and 

9 said control information is represented by said 
10 identifiers of linked image data. 

1 5 6. A transmitting apparatus according to Claim 55, wherein 

2 said transmitting means includes: 

3 reading means for repeatedly reading all combinations 

4 of image data and control information from said first and 

5 second storage means, each combination including one frame 

6 of image data and control information with the same 

7 identifier; 

8 multiplexing means for multiplexing image data and 

9 control information read by said reading means by 

10 transmitting said image data and control information in the 

11 image section and vertical blanking interval, respectively, 

12 of a television signal; and 

13 output means for outputting the multiplexed television 

14 signal as an analog broadcast wave. 



104 




1 57. A transmitting apparatus according to Claim 56, wherein 

2 said multiplexing means transmits an image representing an 

3 identifier in a fixed position in a non-displayed part of 

4 said image data. 

1 58. A transmitting apparatus according to Claim 55, wherein 

2 said transmitting means includes: 

3 reading means for repeatedly reading all combinations 

4 of image data and control information from said first and 

5 second storage means, each combination including one frame 

6 of image data and corresponding control information; 

7 multiplexing means for converting image data into a 

8 first digital data stream and control information read by 

9 said reading means into a second digital data stream, and 

10 multiplexing said digital data streams so as to produce a 

11 multiplexed stream; and 

12 output means for outputting said multiplexed stream as 

13 a digital broadcast wave. 

1 59. A transmitting apparatus according to Claim 58, wherein 

2 said multiplexing means includes: 

3 a converter for converting image data into a first 

4 digital data stream and control information into a second 

5 digital data stream; 

6 an ID allocating unit for allocating first identifying 

7 information to said first digital data stream for 
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8 identifying image data and second identifying information to 

9 said second digital data stream for identifying control 

10 information; 

11 a table producing unit for producing a mapping table 

12 showing the correspondence between said first identifying 

13 information and image data identifiers and the 

14 correspondence between said second identifying information 

15 and control information identifiers; and 

16 a multiplexing unit for multiplexing said first digital 

17 data stream, said second digital data stream, and said 

18 mapping table. 

1 60. A transmitting apparatus according to Claim 55, further 

2 comprising: 

3 third producing means for producing audio data 

4 according to audio information contained in said page 

5 information, and allocating said identifiers to said audio 

6 data corresponding to said image data; and 

7 third storage means for storing said audio data 

8 together with said identifiers, 

9 wherein said transmitting means transmits said audio 
10 data as well as said image data. 

1 61. A transmitting apparatus according to Claim 60, wherein 

2 said transmitting means includes: 

3 reading means for repeatedly reading all combinations 

4 of image data, audio data, and control information from said 
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5 first, second, and third storage means, each combination 

6 including image data, audio data, and control information 

7 with the same identifier; 

8 multiplexing means for multiplexing one combination of 

9 image data, audio data, and control information read by said 

10 reading means to produce a television signal, said audio 

11 data being transmitted on a television audio signal, a 

12 plurality of frames of image data and control information 

13 required for reproducing said audio data being transmitted 

14 in the image section and vertical blanking interval, 

15 respectively, of a television image signal; and 

16 output means for outputting the multiplexed television 

17 signal as an analog broadcast wave. 

1 62 . A transmitting apparatus according to Claim 61, wherein 

2 said multiplexing means transmits an identifier representing 

3 an image in a fixed position in a non-displayed part of said 

4 image section. 

1 63. A transmitting apparatus according to Claim 60, wherein 

2 said transmitting means includes: 

3 reading means for repeatedly reading all combinations 

4 of image data, audio data, and control information from said 

5 first, second, and third storage means, each combination 

6 including image data, audio data, and control information 

7 with the same identifier; 

8 multiplexing means for converting image data, audio 
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9 data, and control information read by said reading means 

10 into digital data streams, and multiplexing said digital 

11 data streams so as to produce a multiplexed stream; and 

12 output means for outputting said multiplexed streams as 

13 a digital broadcast wave. 

1 64. A transmitting apparatus according to Claim 63, wherein 

2 said multiplexing means includes: 

3 a converter for converting image data into a first 

4 digital data stream, control information into a second 

5 digital data stream, and audio data into a third digital 

6 data stream; 

7 an ID allocating unit for allocating first identifying 

8 information to said first digital data stream to identify 

9 image data, second identifying information to said second 

10 digital data stream to identify control information, and 

11 third identifying information to said third digital data 

12 stream to identify audio data; 

13 a table producing unit for producing a mapping table 

14 showing the correspondence between said first identifying 

15 information and image data identifiers, the correspondence 

16 between said second identifying information and control 

17 information identifiers, and the correspondence between said 

18 third identifying information and audio data identifiers; 

19 and 

20 a multiplexing unit for multiplexing said first, 

21 second, and third digital data streams, and said mapping 
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22 table. 

1 65. A receiving apparatus for an interactive communication 

2 system using a broadcast wave, wherein said broadcast wave 

3 is produced by multiplexing a plurality of frames of image 

4 data, and control information which includes image link 

5 information for each frame of image data showing links with 

6 other frames of image data and supplementary design 

7 combining information indicating the combining of a 

8 supplementary design with said plurality of frames of image 

9 data, said broadcast wave being repeatedly transmitted, and 

10 said supplementary design being combined with an image of 

11 the image data, 

12 wherein said receiving apparatus comprises: 

13 separating means for separating a frame of image data 

14 and corresponding control information from said broadcast 

15 wave; 

16 supplementary design storage means for storing at least 

17 one supplementary design; 

18 supplementary design reading means for reading a 

19 supplementary design from the supplementary design storage 

20 means, based on the separated control information; 

21 combining means for combining the read supplementary 

22 design with the separated image data; 

23 storage means for storing said combined image data and 

24 separated control information; 

25 reproducing means for reproducing said stored image 
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26 data to output an image signal; 

27 operation means for receiving an operation instruction 

28 from a user to switch image data; and 

29 control means for controlling said separating means to 

30 separate another frame of image data designated by said 

31 control information stored in said storage means according 

32 to said operation instruction. 

1 66. A receiving apparatus according to Claim 65, 

2 wherein the supplementary design combining information 

3 includes information indicating a combining of a 

4 supplementary design with a specific image part and a 

5 classification of the specific image part, 

6 wherein the supplementary design reading means 

7 includes: 

8 determining means for determining the classification in 

9 the supplementary design combining information included in 

10 the control information separated by the separating means; 

11 and 

12 supplementary design specifying means for specifying a 

13 supplementary design in the supplementary design storage 

14 means which corresponds to the* determined classification. 

1 67 . A receiving apparatus according to Claim 66, wherein the 

2 classification indicates a headline as the specific image 

3 part and the supplementary design specifying means specifies 

4 a supplementary design which emphasizes the specific image 
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5 part. 

1 68 . A receiving apparatus according to Claim 67, 

2 wherein the supplementary design combining information 

3 includes coordinate information indicating the specific 

4 image part, 

5 wherein the determining means reads the coordinate 

6 information; and 

7 wherein the combining means combines the image data and 

8 the supplementary design based on the read coordinate 

9 information. 

1 69, A receiving apparatus according to Claim 68, 

2 wherein the supplementary design is an image of a 

3 rectangle, 

4 wherein the combining means includes supplementary 

5 design converting means for converting the size of the 

6 supplementary design so that the rectangle surrounds the 

7 headline, 

8 and wherein the combining means combines the converted 

9 supplementary design and the image data. 

1 70. A receiving apparatus according to Claim 66, wherein the 

2 classification indicates one of a character and image to 

3 which a link has been attached as the specific image part 

4 and wherein the supplementary design specifying means 

5 specifies a supplementary design which shows that the 
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6 Specific image part has an attached link to other image 

7 data. 

1 71. A receiving apparatus according to Claim 70, wherein the 

2 supplementary design combining information includes 

3 coordinate information indicating the specific image part, 

4 wherein the determining means reads the coordinate 

5 information; and 

6 wherein the combining means combines the image data and 

7 the supplementary design based on the read coordinate 

8 information. 

1 72. A receiving apparatus according to Claim 71, 

2 wherein the supplementary designs stored in the 

3 supplementary design storage means which are used for 

4* showing that a link to other image data is attached are 

5 composed of two types which respectively correspond to a 

6 selection and a non-selection state, 

7 wherein the operation means receives a selection 

8 operation from the user for one of a character and an image 

9 to which a link is attached, 

10 wherein the receiving apparatus includes state storage 

11 means for storing a selection or non-selection state in 

12 accordance with an instruction from the operation means, and 

13 wherein the supplementary design reading means reads a 

14 supplementary design corresponding to a state stored in the 

15 state storage means from the supplementary design storage 
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16 means. 

1 73. A receiving apparatus according to Claim 65, 

2 wherein the control information received from a 

3 transmitting apparatus further includes a supplementary 

4 design, and 

5 wherein the receiving apparatus further comprises 

6 supplementary design recording means for recording a 

7 supplementary design included in the separated control 

8 information in the supplementary design storage means. 

1 74. A receiving apparatus according to Claim 65, 

2 wherein the supplementary design storage means includes 

3 a plurality of supplementary designs, 

4 wherein the receiving apparatus further comprises 

5 supplementary design selecting means for selecting one 

6 supplementary design from the plurality of supplementary 

7 designs stored by the supplementary design storage means, in 

8 accordance with a user operation, and 

9 wherein the supplementary design reading means reads 
10 the selected supplementary design. 

1 75. A receiving apparatus according to Claim 65, 

2 wherein the identifier allocated to a frame of image 

3 data is the same as the identifier allocated to 

4 corresponding control information, 

5 wherein said control information expresses the 
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6 identifier allocated to linked image data, 

7 wherein said separating means includes: 

8 first detecting means for detecting said identifier 

9 allocated to said image data; 

10 second detecting means for detecting said identifier 

11 allocated to said control information; and 

12 obtaining means for obtaining said image data and 

13 control information if said first and second detecting means 

14 have detected said identifiers, 

15 and wherein said storage means stores said image data 

16 and control information obtained by said obtaining means. 

1 76, A receiving apparatus according to Claim 75, 

2 wherein image data and control information are 

3 transmitted in the image section and vertical blanking 

4 interval, respectively, of a television signal as a 

5 multiplexed analog broadcast wave, 

6 wherein an identifier to be shown as an image is 

7 transmitted in a fixed position in non-displayed part of 

8 said image section, and 

9 wherein said first judging means recognizes an 

10 identifier from an image in a fixed position in said non- 

11 displayed part. 

1 77. A receiving apparatus according to Claim 65, 

2 wherein the same identifier is allocated to image data 

3 and corresponding control information, 
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4 wherein said image data and control information are 

5 converted into digital data streams to be multiplexed to 

6 transmit a multiplexed stream as a multiplexed digital 

7 broadcast wave, 

8 wherein said digital data streams are allocated first 

9 identifying information to identify image data and second 

10 identifying information to identify control information, 

11 wherein said multiplexed stream comprises said digital 

12 data streams and a mapping table showing the correspondence 

13 between said first identifying information and image data 

14 identifiers and the correspondence between said second 

15 identifying information and control information identifiers, 

16 said digital data streams and said mapping table being 

17 multiplexed, 

18 wherein said storage means stores a mapping table 

19 separated by said separating means, 

2^ wherein said control means recognizes an identifier of 

21 linked image data indicated by control information, converts 

22 said identifier into first identifying information and 

23 second identifying information referring to a mapping table, 

24 and sets said first identifying information and second 

25 identifying information to said separating means, 

26 and wherein said separating means includes: 

27 first detecting means for detecting said first 

28 identifying information from said multiplexed stream; 

29 second detecting means for detecting said second 

30 identifying information from said multiplexed stream; and 
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31 obtaining means for obtaining image data and control 

32 information indicated by said first and said second 

33 identifying information detected by said first and second 

34 detecting means. 

1 78. A receiving apparatus according to Claim 65, 

2 wherein said control information is expressed by at 

3 least one combination of a coordinate showing image part in 

4 image data corresponding to said control information, and 

5 the identifier allocated to linked image data, 

6 wherein said operation means receives an operation 

7 instruction to designate said image part in image data, 

8 and wherein said control means reads the identifier 

9 allocated to linked image data corresponding to said 

10 designated image region, and sets said identifier to said 

11 separating means. 

1 7 9. A receiving apparatus for an interactive communication 

2 system using a broadcast wave produced by multiplexing a 

3 plurality of frames of image data, control information which 

4 includes image link information for each frame of image data 

5 showing links with other frames of image data and 

6 supplementary design combining information indicating the 

7 combining of a supplementary design with said plurality of 

8 frames of image data, and audio data corresponding to said 

9 plurality of frames of image data, said broadcast wave being 
10 repeatedly transmitted, and said supplementary design being 
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11 combined with an image represented by the image data, 

12 wherein the receiving apparatus comprises: 

13 separating means for separating a frame of image data 

14 and corresponding control information and audio data from 

15 said broadcast wave; 

16 supplementary design storage means for storing at least 

17 one supplementary design; 

18 supplementary design reading means for reading a 

19 supplementary design from the supplementary design storage 

20 means, based on the separated control information; 

21 combining means for combining the read supplementary 

22 design with the separated image data; 

23 Storage means for storing said combined image data and 

24 separated control information and audio data; 

25 reproducing means for reproducing said stored image 

26 data and audio data to output an image signal and an audio 

27 signal; 

28 operation means for receiving an operation instruction 

29 to switch image data; and 

30 control means for controlling said separating means to 

31 separate another frame of image data designated by said 

32 control information stored in said storage means according 

33 to said operation instruction. 

1 80. A receiving apparatus according to Claim 79, 

2 wherein the identifier allocated to a frame of image 

3 data is the same as the identifier allocated to 
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4 corresponding control information, 

5 wherein said control information expresses the 

6 identifier allocated to linked image data, 

7 wherein said separating means includes: 

8 first detecting means for detecting said identifier 

9 allocated to said image data; 

10 second detecting means for detecting said identifier 

11 allocated to said control information; and 

12 obtaining means for obtaining said image data and 

13 control information if said first and second detecting means 

14 have detected said identifiers, 

15 and wherein said storage means stores said image data 

16 and control information obtained by said obtaining means . 

1 81. A receiving apparatus according to Claim 80, 

2 wherein said separating means further includes audio 

3 separating means for separating audio data corresponding to 

4 said image data, and 

5 wherein said storage means stores said audio data 

6 separated by said audio separating means, 

1 82. A receiving apparatus according to Claim 79, 

2 wherein image data and control information are 

3 transmitted in the image section and vertical blanking 

4 interval, respectively, of a television image signal as a 

5 multiplexed analog broadcast wave, while audio data are 

6 transmitted as a television audio signal. 
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7 wherein an identifier to be shown as an image is 

8 transmitted in a fixed position in non-displayed part of 

9 said image section, and 

10 wherein said first detecting means recognizes an 

11 identifier from an image in a fixed position of said non- 
12 displayed part. 

1 83. A receiving apparatus according to Claim 79, 

2 wherein the same identifier is allocated to image data 

3 and corresponding control information and audio data, 

4 wherein said image data, audio data and control 

5 information are converted into digital data streams to be 

6 multiplexed to transmit a multiplexed stream as a 

7 multiplexed digital broadcast wave, 

8 wherein said digital data streams are allocated first 

9 identifying information to identify image data, second 

10 identifying information to identify control information, and 

11 third identifying information to identify audio information, 

12 wherein said multiplexed, stream comprises said digital 

13 data streams and a mapping table showing the correspondence 

14 between said first identifying information and image data 

15 identifiers, the correspondence between said second 

16 identifying information and control information identifiers, 

17 and the correspondence between said third identifying 

18 information and audio information identifiers, said digital 

19 data streams and said mapping table being multiplexed, 

20 wherein said storage means stores a mapping table 
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21 separated by said separating means, 

22 wherein said control means recognizes an identifier of 

23 linked image data indicated by control information, converts 

24 said identifier into first identifying information, second 

25 identifying information and third identifying information by 

26 referring to a mapping table, and sets said first 

27 identifying information, second identifying information, and 

28 third identifying information in said separating means, 

29 and wherein said separating means includes: 

30 first detecting means for detecting said first 

31 identifying information from said multiplexed stream; 

32 second detecting means for detecting said second 

33 identifying information from said multiplexed stream; and 

34 second detecting means for detecting said second 

35 identifying information from said multiplexed stream; and 

36 third detecting means for detecting said third 

37 identifying information from said multiplexed stream; and 

38 obtaining means for obtaining image data, audio data, 

39 and control information indicated by said first, second and 

40 third identifying information detected by said first, 

41 second, and third detecting means. 

1 84. A receiving apparatus according to Claim 79, 

2 wherein said control information is expressed by at 

3 least one combination of a coordinate showing image part in 

4 image data corresponding to said control information, and 

5 the identifier allocated to linked image data. 
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6 wherein said operation means receives an operation 

7 instruction from a user to designate said image part in 

8 image data, and 

9 wherein said control means reads the identifier 

10 allocated to linked image data corresponding to said 

11 designated image region, and sets said identifier to said 

12 separating means* 

1 85. A receiving method used in a receiving apparatus for an 

2 interactive communication system using a broadcast wave 

3 produced by multiplexing a plurality of frames of image data 

4 and control information including link information showing a 

5 link to another of said plurality of frames of image data 

6 and supplementary design combining information for each 

7 frame of image data indicating a combining of a 

8 supplementary design and the image data, the supplementary 

9 design being combined with an image represented by the image 

10 data, 

11 wherein said receiving method comprises: 

12 a separating step for separating a frame of image data 

13 and corresponding control infoinuation from said broadcast 

14 wave; 

15 a supplementary design reading step for reading a 

16 supplementary design stored in a memory; 

17 a combining step for combining the read supplementary 

18 design and the image data; 

19 a storage step for storing said combined image data and 
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20 said separated control information in a memory; 

21 a reproducing step for reproducing said image data 

22 stored in the memory to output an image signal; 

23 a operation step for receiving a user operation 

24 instruction to switch image data; 

25 a determining step for determining image data indicated 

26 by said control information stored in a memory according to 

27 said operation instruction; and 

28 a second separating step for separating said determined 

29 image data and corresponding control information from said 

30 broadcast wave . 

1 86 • A recording medium for recording a receiving program 

2 used in a receiving apparatus for an interactive 

3 communication system using a broadcast wave produced by 

4 multiplexing a plurality of frames of image data and control 

5 information including link information showing a link to 

6 another of said plurality of frames of image data and 

7 supplementary design combining information for each frame of 

8 image data which indicates a combining of a supplementary 

9 design with the image data, the supplementary design being 

10 combined with an image represented by the image data, 

11 wherein the receiving program comprises the steps of: 

12 a separating step for separating a frame of image data 

13 and corresponding control information from said broadcast 

14 wave; 

15 a supplementary design reading step for reading a 
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16 supplementary design stored in a memory; 

17 a combining step for combining the read supplementary 

18 design and the image data; 

19 a storage step for storing said combined image data and 

20 said separated control information in a memory; 

21 a reproducing step for reproducing said image data 

22 stored in the memory to output an image signal; 

23 a operation step for receiving a user operation 

24 instruction to switch image data; 

25 a determining step for determining image data indicated 

26 by said control information stored in a memory according to 

27 said operation instruction; and 

28 a second separating step for separating said determined 

29 image data and corresponding control information from said 

30 broadcast wave. 

1 87. An interactive communication system using a broadcast 

2 wave, comprising a transmitting apparatus and a receiving 

3 apparatus, 

4 said transmitting apparatus comprising: 

5 first storage means for storing a plurality of frames 

6 of image data; 

7 second storage means for storing control information 

8 which shows links between said plurality of frames of image 

9 data stored in said first storage means, and which indicates 

10 a combining of a supplementary design with the image data 

11 stored in the first storage means, the supplementary design 
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12 being stored by a receiving apparatus and being combined 

13 with an image represented by the image data; and 

14 transmitting means for repeatedly transmitting a 

15 predetermined number of frames of image data together with 

16 corresponding control information, 

17 and said receiving apparatus comprising: 

18 separating means for separating a frame of image data 

19 and corresponding control information from said broadcast 

20 wave; 

21 supplementary design storage means for storing at least 

22 one supplementary design; 

23 supplementary design reading means for reading a 

24 • supplementary design from the supplementary design storage 

25 means, based on the separated control information; 

26 combining means for combining the read supplementary 

27 design with the separated image data; 

28 storage means for storing said combined image data and 

29 separated control information; 

30 reproducing means for reproducing said stored image 

31 data to output an image signal; 

32 operation means for receiving an operation instruction 

33 from a user to switch image data; and 

34 control means for controlling said separating means to 

35 separate another frame of image data designated by said 

36 control information stored in said storage means according 

37 to said operation instruction. 



124 



1 88. An interactive communication system according to Claim 

2 87, wherein the transmitting means includes: 

3 reading means for repeatedly reading said predetermined 

4 number of frames of image data together with said 

5 corresponding control information from said first and second 

6 storage means; 

7 multiplexing means for multiplexing image data and 

8 control information read by said reading means by 

9 transmitting said image data and control information in 

10 image sections and vertical blanking intervals, 

11 respectively, of a television signal; and 

12 output means for outputting the multiplexed television 

13 signal as an analog broadcast wave. 

1 89. An interactive communication system according to Claim 

2 87, wherein said image data and control information stored 

3 in said first and second storage means are digitized, 

4 and wherein said transmitting means includes: 

5 reading means for repeatedly reading said predetermined 

6 number of frames of image data together with said 

7 corresponding control information from said first and second 

8 storage means; 

9 multiplexing means for converting image data and 

10 control information read by said reading means into digital 

11 data streams, and multiplexing said digital data streams to 

12 produce a multiplexed stream; and 

13 , output means for outputting said multiplexed stream as 
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14 a digital broadcast wave. 

1 90. An interactive communication system using a broadcast 

2 wave, comprising a transmitting apparatus and a receiving 

3 apparatus, 

4 wherein said transmitting apparatus comprises: 

5 first storage means for storing a plurality of frames 

6 of image data with an identifier allocated to each frame of 

7 image data; 

8 second storage means for storing control information 

9 for each frame of image data showing a link to another frame 

10 of image data stored in said first image storage means, the 

11 same identifier being allocated to corresponding image data 

12 and control information, and said control information also 

13 indicating a combining of a supplementary design with the 

14 image data stored in the first storage means, the 

15 supplementary design is being stored by a receiving 

16 apparatus and being combined with an image represented by 

17 the image data; and 

19 transmitting means for repeatedly transmitting a 

19 predetermined number of frames of image data together with 

20 corresponding control information, 

21 and said receiving apparatus comprises: 

22 separating means for separating a frame of image data 

23 and corresponding control information from said broadcast 

24 wave ; 

25 supplementary design storage means for storing at least 
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26 one supplementary design; 

27 supplementary design reading means for reading a 

28 supplementary design from the supplementary design storage 

29 means, based on the separated control information; 

30 combining means for combining the read supplementary 

31 design with the separated image data; 

32 storage means for storing said combined image data and 

33 separated control information; 

34 reproducing means for reproducing said stored image 

35 data to output an image signal; 

36 operation means for receiving an operation instruction 

37 from a user to switch image data; and 

38 control means for controlling said separating means to 

39 separate another frame of image data designated by said 

40 control information stored in said storage means according 

41 to said operation instruction. 

1 91. An interactive communication system according to Claim 

2 90, 

3 wherein said control information is represented by said 

4 identifiers of linked image data, 

5 and wherein said separating means includes: 

6 first detecting means for detecting said identifier 

7 allocated to said image data; 

8 second detecting means for detecting said identifier 

9 allocated to said control information; and 

10 obtaining means for obtaining said image data and 
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11 control information if said first and second detecting means 

12 have detected said identifiers. 

13 92. An interactive communication system using a broadcast 

14 wave, comprising a transmitting apparatus and a receiving 

15 apparatus, 

16 wherein the transmitting apparatus comprises: 

17 obtaining means for obtaining pieces of page 

18 information representing a page containing characters and 

19 images, said page information including link information to 

20 show a link to another page, character information, and 

21 image information; 

22 first producing means for producing one frame of image 

23 data containing characters and images in accordance with 

24 said character information and image information included in 

25 a piece of page information; 

26 second producing means for interpreting said link 

27 information included in said obtained page information and 

28 producing, for each frame of image data, control information 

29 including image link information about a link to another 

30 frame of image data and supplementary design combining 

31 information indicating a combining of a supplementary design 

32 with the frame of image data generated by the first 

33 producing means, the supplementary design being stored by a 

34 receiving apparatus and being combined with an image 

35 represented by the image data; 

36 first storage means for storing a predetermined number 
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37 of frames of image data produced by said first producing 

38 means; 

39 second storage means for storing said control 

40 information produced by said second producing means; and 

41 transmitting means for repeatedly transmitting said 

42 predetermined number of frames of image data together with 

43 said control information, 

44 and said receiving apparatus comprises: 

45 separating means for separating a frame of image data 

46 and corresponding control information from said broadcast 

47 wave; 

48 supplementary design storage means for storing at least 

49 one supplementary design; 

50 supplementary design reading means for reading a 

51 supplementary design from the supplementary design storage 

52 means, based on the separated control information; 

53 combining means for combining the read supplementary 

54 design with the separated image data; 

55 Storage means for storing said combined image data and 

56 separated control information; 

57 reproducing means for reproducing said stored image 

58 data to output an image signal; 

59 operation means for receiving an operation instruction 

60 from a user to switch image data; and 

61 control means for controlling said separating means to 

62 separate another frame of image data designated by said 

63 control information stored in said storage means according 
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64 to said operation instruction. 
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ABSTRACT OF THE DISCLOSURE 

A transmitting apparatus for an interactive 
communication system using a broadcast wave, which includes 
a first storage unit, a second storage unit, and a 
5 transmitting unit. The first storage unit stores a 

plurality of frames of image data. The second storage unit 
stores control information which shows links between said 
plurality of frames of image data stored in the first 
storage unit, and which indicates a combining of a 

10 supplementary design with the image data. These 

supplementary designs are stored by a receiving apparatus 
and are combined with the image represented by the image 
data. The transmitting unit repeatedly transmits a 
predetermined number of frames of image data together with 

15 corresponding control information. 
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COMBINED DECLARATION AND POWER OF ATTORNEY 
IN ORIGINAL APPLICATION 

As a below named inventor, I hereby declare that my residence, post office address and citizenship are as stated below next to my name; that I verily believe 
that I am the original, first and sole inventor (if only one name is listed below) or joint inventor (if plural inventors arc named below) of the subject matter which 
is claimed and for which a patent is sought, entitled: 

DATA COMMUNICATION SYSTEM, DATA TRANSMITTING APPARATUS, 

AND DATA RECEIVING APPARATUS * 



the specification of which: 

(check one) □ is attached hereto. 



13 was filed on June 2, 1997 



Application Serial No. 08/867,344 
and was amended on .. 



(if applicable) 

I hereby slate that I have reviewed and understand the contents of the above-identified specification, including the claims, as amended by any amendment 
referred to above, 

I acluiowlcdgc the duly to disclose information which is material to the examination of this application in accordance with Title 37, Code of Federal 
Regulations, § 1 .56(a). 

I hereby claim foreign priority benefits under Title 35, United States Code, § 1 19 of any foreign applicalion(s) for patent or invcntoi's certificate listed below 
and have also identified below any foreign application for patent or inventor's certificate having a filing date before (hat of the application on which priority is 
claimed. 



Foreign application{s), if any, for Patent or Invcntoi's Certificate Filed Within 12 Months Prior to the Filing Dale of This Application: 

Country Application No. Date of Filing pric 

^ ^ * (day, month, year) Undei 

Japan 8-138500 3l/May/1996. ves X 



Ye s No_ 

Yes No„ 

Yes No_ 

Ye s No_ 

Ye s No 



All Foreign Applications, if any, for Patent or Inventor's Certificate Filed More Than 12 Months Prior to the Filing Date of This Applicafion: 
Country Application No. Date of Filing 



I hereby claim the benefit under Title 35. United Slates Code, § 120 of any United Slates appIication(s) listed below and, insofar as the subject matter of each 
of the claims of tiiis application is not disclosed in the prior United Stales application in manner provided by the first paragraph of Title 35, United States Code, 
§ 112, 1 acknowledge the duty to disclose material information as defined in Title 37, Code of Federal Regulations, § 1,56(1) which occurred between the filing 
date of the prior application and the national orPCT international filing date of this application: 



(Application Serial No.) (Fifing Date) (Status) 

(patented, pending^ abandoned) 



(Application Serial No.) (Filing Date) (Status) 

Oiatented, pending, abandoned) 



I-hcrcby appoint the following altomi and/or agcnt(s) to prosecute this application and to irai all business in the Patent and Trademark Office connccte< 
therewith: 

Joseph W. Price (Reg. 25,1 24) " Stefan J. Kirchanski (Reg. 36,568] 

Franklin D. Ubell (Reg, 27,009) Doyle B. Johnson (Reg. 39,240] 

Albin H. Gess (Reg. 25,726) Michael J. Moffatt (Reg. 39,304] 

Send Correspondence To: 

Price, Gess & Ubell 

21 00 S.E. Main Street, Suite 250 
Irvine, California 92715 
Telephone: 714/261-8433 



I hereby declare that all statements made herein of my own knowledge arc toie and that all statements made on information and belief are believed lo be true; and 
further, that these slalcments were made with the knowledge that wilful false statements and the like are punishable by fine or imprisonment or both ( 1 8 U.S.C. 
1001) and may jeopardize the validity of the application or any patent issOed thereon. 
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1997 
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CITIZENSHIP 

Japan 
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^f" Junichi HIRAI 
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1997 
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CITIZENSHIP 

Japan 
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^^3Yoshiyuki MIYABE 
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DATE,, 

May 27, 
1997 


RESIDENCE 3«g„ii^505, Higashimikuni, irodogawa-ku, 
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CITIZENSHIP 

Japan 
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